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Preface 


During the past fifteen years, digital signal processing has been an extremely active and dynamic 
field. Advances in integrated circuit technology and in processor architecture have greatly enlarged the 
scope of the technical areas to which digital signal processing techniques can be applied. Research in 
fundamental signal processing techniques and algorithms has led to dramatic improvements in the 
efficiency of signal processing systems. 


An important facet of the progress in digital signal processing has been the development of algo- 
rithms and their embodiment in computer programs, both for the execution of processing operations on 
signals and for the design of signal processing filters and systems. The purpose of this book is to make 
widely available, in a directly usable form, a comprehensive set of computer programs useful for digital 
signal processing. In addition, the book serves as an outlet for excellent programming effort and 
enables authors of programs to receive credit for their work. 


The programs have been carefully selected to cover a broad spectrum of digital signal processing 
applications and design techniques. The programs are categorized into eight chapters, and separate 
summaries (authored by chapter editors who were also asked to make final checks on the documenta- 
tion and code) are provided with each chapter. The first chapter focuses on the Discrete Fourier 
Transform (DFT) and presents a variety of Fast Fourier Transform (FFT) and related algorithms. 
Chapter 2 includes algorithms for the periodogram and correlation methods of power spectrum estima- 
tion and for coherence and cross spectrum estimation. A program for high speed, FFT-based convolu- 
tion is presented in Chapter 3. Chapter 4 presents several algorithms related to the linear prediction 
techniques of signal processing, including the autocorrelation, covariance, and lattice methods. The 
design and synthesis of Finite Impulse Response (FIR) digital filters are the subjects of Chapter S. 
Algorithms for optimal (minimax), windowed, and maximally-flat filter designs, and a design program 
which incorporates finite-word-length effects, are included. Chapter 6 presents a comprehensive set of 
programs dealing with the design and synthesis of Infinite Impulse Response (IIR) digital filters. The 
first program in that chapter includes most of the classical filter design techniques as well as considera- 
tion of finite word length issues such as pairing and ordering in a single but modular package. The 
other programs in that chapter are specialized either to the finite word length design problem or to filter 
design based on iterative optimization. Chapter 7 deals with cepstral and homomorphic algorithms, 
with specific attention to the difficult problem of phase calculation in a homomorphic system. Finally, 
Chapter 8 presents several programs for interpolation and decimation, the fundamental operations 
necessary for changing sampling rates in a digital system. Included are multistage implementations and 
sampling rate conversion by rational ratios. 


The book is the culmination of a project undertaken in early 1976 by the Digital Signal Processing 
Committee of the IEEE Acoustics, Speech, and Signal Processing Society. In contrast to previous 
books in the IEEE Press reprint series, this book consists largely of material which has not been pub- 
lished before. In addition, a unique and complex set of issues regarding the publication of computer 
programs had to be dealt with. These issues included: (1) clarity and uniformity of documentation and 
program presentation; (2) independent review and verification of all programs; (3) portability and 
machine-independence of code; and (4) availability of computer-readable source programs. The project 
has therefore been a very ambitious and time-consuming one for the committee, for the program con- 
tributors, and for the reviewers. 


In order to assess the feasibility of the project, the committee distributed to the digital signal pro- 
cessing community in early 1976 a description of the proposed project and a request for descriptions of 
candidate programs. The distribution of this request was carried out both through direct mailing and 
through handouts at the 1976 International Conference on Acoustics, Speech, and Signal Processing. 
In a short time, enough very promising candidate programs had been identified to convince the com- 
mittee that the book was not only feasible, but potentially a landmark contribution to the digital signal 
processing field. In addition, a reasonable organization of the material into the eight sections now 
included in the book began to emerge. 


Because of the large effort to be required of program contributors and of reviewers, it was deemed 
desirable to pre-screen program candidates based on the offered descriptions, and invite submission of 
only those programs judged most likely to fit our rather stringent requirements. In cases where two 


programs were offered to accomplish the same functions, a choice was generally made based on which 
of the programs was closer to publishable form in terms of documentation, portability, verification 
through wide previous use, or other similar criteria. 


After this pre-screening, invitations were sent to prospective authors to submit full code and docu- 
mentation for their programs. It was required of the authors that all programs meet the following con- 
ditions: 


(1) complete user documentation must be included; 
(2) the program must be in FORTRAN and conform to ANSI FORTRAN standards; 


(3) the code should be fully commented and debugged, and as clear and understandable as pos- 
sible; 
(4) the code should be transportable and machine-independent; 


(5) comprehensive test examples with corresponding input and output should be supplied. 


Of course, in addition to printouts, a computer-readable source of all code had to be provided by the 
authors. This led to the rather onerous task of collecting the submitted tapes and cards, reading them 
into a central filing system, and distributing them to reviewers in one of several possible formats. 


The committee viewed it to be an essential part of the project that computer-readable source 
material for the programs be made available to readers of the book. The collection of all programs into 
a central file was clearly necessary to achieve this. In addition, with the cooperation of Reed Crone of 
IEEE Press and Jack Fraum of the IEEE Service Center, we were able to arrange for IEEE to offer the 
service of reproducing and distributing, upon request and at a nominal cost, a tape of all programs in 
the book. For information on how to order such a tape, contact the IEEE Press, 345 East 47" St., New 
York, NY 10017. It is worth emphasizing that this is a new service which IEEE has not offered in the 
past, and which can perhaps be utilized again in other projects. 


As authors submitted programs, the review process was able to proceed. Each reviewer was asked 
to act from points of view (1) of a highly critical program user, and (2) of an editorial reviewer of 
journal-quality technical material. The reviewer was asked to read the program description, compile the 
program, and attempt to run the test examples described as well as other test examples considered 
appropriate. The review process was an open one, with reviewers frequently consulting directly with 
authors on points of difficulty, In most cases it was found that the material submitted by authors was 
excellent and well-debugged, and the review process went quite smoothly. However, in some cases 
serious difficulties, particularly in the area of program portability, were uncovered and corrected in the 
review process. At the end of the book, we have identified the reviewer (s) as well as the computer (s) 
and operating system(s) on which each program was tested. In addition to giving credit for the efforts 
of the reviewers, this serves to identify for readers at least one successful user of each program besides 
the author(s). 


Program portability was the objective of major importance in this project. One successful review was 
not considered sufficient to insure that this goal was met; therefore an extensive parallel effort in pro- 
gram standardization was undertaken. The standardization procedures are described in detail in the 
standards section. 


Much care has been taken to insure the accuracy, clarity, and uniformity of the printed material in 
the book. All listings of program code have been printed directly from the centrally-collected 
computer-readable source material, with particular attention to the selection of a readable type font. 
This was considered necessary to avoid either direct photoreproduction of the assorted type fonts pro- 
duced by authors or the inevitable errors which would be caused by attempting to transcribe and typeset 
the listings. The authors’ manuscripts documenting their programs were typed into a computer system, 
after which final editing and correcting were carried out. All the printed material in the book was then 
produced by computer-driven phototypesetters. 


Although this has been a project of the full Digital Signal Processing Committee as listed on the title 
page, a number of outstanding individual contributions deserve special mention here. The idea for this 
project was first presented to the committee by Ronald Crochiere in early 1976, and the project was 


initiated under the committee chairmanship of Alan Oppenheim. Crochiere was responsible for the ini- 
tial solicitation and collection of candidate programs from the digital signal processing community. 
Clifford Weinstein took over as committee chairman in September 1976 and since that time served as 
general coordinator for the program book project. 


The task of collecting submitted tapes and cards from the authors, reading them into a central file, 
and distributing them for review in specified formats, was initially carried out by Howard Helms and 
later taken over by Marie Dolan. Helms was also instrumental in arranging for IEEE reproduction of 
the program tape for users. To insure the standardization and portability of the programs, a standardi- 
zation subcommittee including James Kaiser, Dolan, Carol McGonegal, Lawrence Rabiner, and Jose 
Tribolet was made responsible for detailed specification and execution of the standards imposed on the 
programs in this book. The typing of author manuscripts into a computer file was carried out by Penny 
Blaine and Carmela Patuto. Art editing and page layout were skillfully handled by Madeline Wilson. 
Kaiser coordinated the handling of manuscripts and arranged for the phototypesetting of the book. 
Much of this phototypesetting was done by Yourdon, Inc., New York City. The subcommittee of 
Kaiser, Dolan, McGonegal, and Rabiner took charge of tracking and carrying out the many details 
required to bring the book into final form. 


Special thanks are due to Marie Dolan and Carol McGonegal, who joined the committee for the 
express purpose of participating in the program book project and who put forth enormous and very pro- 
ductive effort in seeing it through to completion. We would like to acknowledge the excellent coopera- 
tion and assistance provided to this project by IEEE Press Managing editor Reed Crone, and the specific 
efforts of Jack Fraum in arranging for IEEE reproduction of the program tape. Finally, the Committee 
must thank the program authors, reviewers, and chapter editors for the large amounts of time and 
effort they contributed to this project. 
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Standards 


In putting together this collection of programs on digital signal processing, it was immediately recog- 
nized that users would be trying to run the different programs on a wide variety of computing machines 
and under several types of operating systems. For this reason FORTRAN was chosen as the principal 
language and a great deal of attention was given to the problem of program portability. The goal was 
for each program to compile and execute, according to its defined performance criteria, on a wide range 
of computers. Adopted was the PORT Mathematical Subroutine Library approach toward portability of 
Fox, Hall, and Schryer [1]. That is, all programs "had to be portable in the IFIP sense*, with the 
exception that the three machine-constant defining functions had to be particularized to the host com- 
puter once, at installation". The techniques used in the PORT library and in the programs in this book 
to make them easily portable were: (1) the programs are written in a subset of ANSI FORTRAN, and 
(2) the target environment is specified in terms of machine-dependent parameters. In addition to por- 
tability, program readability was given consideration in this collection of programs. The goal was to 
enhance the readability of the program code by standardizing the format of the programs. Following is 
a discussion of the techniques used to make the programs portable and enhance their readability. 


Language 


The programs were restricted to the particular portable subset of ANSI FORTRAN known as 
PFORT (Portable FORTRAN) [3]. The PFORT verifier program [3] checks that individual program 
units conform to the American National Standard FORTRAN [4]; it also checked that the inter- 
program-unit communication through the use of COMMON and argument lists is consistent with the 
standard. During the review each program was passed through the PFORT verifier to guarantee its 
adherence to this language requirement. 


Machine-Dependent Quantities 


All machine-dependent quantities (I/O device codes, machine constants, etc.) are specified by the 
IIMACH, RIMACH and DIMACH FORTRAN function subprograms used in the PORT [1,5] library. 
Table 1 is a list of all the machine-dependent quantities which are specified by these routines. They are 
delivered by means of a single integer argument indicating the particular quantity desired. Complete 
listings of IIMACH, RIMACH and DIMACH are given in the Appendix. Any program in this book 
which is not truly portable, that is, which uses machine-dependent quantities not given in Table 1, is 
however still transportable in the IFIP sense. Additional machine-dependent quantities have been kept 
to a minimum; instructions for changing their values are documented in the program code. 


To move the programs to a new environment, only the DATA statements in the IIMACH, 
R1IMACH and DIMACH subprograms need to be changed. Values are provided in these routines for a 
number of different computing systems. They include the Burroughs 1700 system, the Burroughs 
5700/6700/7700 systems, the CDC 6000/7000 series, the CRAY 1, the Data General Eclipse 8/200, 
the Harris Slash 6 and Slash 7, the Honeywell 6000 series, the IBM 360/370 series, the Xerox SIGMA 
5/7/9, the SEL Systems 85/86, the DEC PDP 10 (KA and KI processors), the DEC PDP 11, the 
UNIVAC 1100 series, and the VAX-11. 


To aid in adding values for a target environment not provided in these subprograms, a description of 
the integer and floating-point variables follows. This description appears in the PORT Mathematical 
Subroutine Library report [1]. 


* The IFIP Working Group (on Numerical Software) (WG2.5) has proposed, in a working draft, the following definitions [2] 

Portable. A program is portable over a given range of machines and compilers if, without any alteration, it can compile and run 
to satisfy specified performance criteria on that range. 
Transportable. In transferring a program between members of a given range of machines and compilers, some changes may 
be necessary to the base version before it satisfies specified performance criteria on each of the machines and compilers. The 
program is transportable if (1) the changes lend themselves to mechanical implementation by a processor, and (2) the 
changes, ideally, are limited in number, extent, and complexity. 
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Standards 


Integer variables: Let the values for integer variables be written in the s-digit, base-a form: 
+(x, a5! + x,_2a5? + + xa + XQ) 


where 0 < x; < afor i = 0,...s—1. Then specify the base a, the maximum number of digits s, and the 
largest integer a@*-1. Although the quantity a*-1 can easily be computed from s and the base a, it is 
provided because a naive evaluation of the formula would cause overflow on most machines and hence 
result in an incorrect value. (Storage of integers as magnitude and sign or in a complement notation is 
not specified since PORT subprograms must be independent of the storage mode.) 


Floating-point variables: If floating-point numbers are written in the Fdigit, base-b form: 


where 0 < x < 6 for i=1,...,4. 0 < x, and @min SE < max, then for a particular machine, choose 
values for the parameters f, min, ANd @,,, Such that all numbers expressible in this form are represent- 
able by the hardware and usable from FORTRAN. Note that the formula is symmetrical under nega- 
tion but not reciprocation. On some machines a small portion of the range of permissible numbers may 
be excluded. Also, for 2’s complement machines, care must be taken in assigning the values. 


For each machine one must specify for real (single-precision) floating-point numbers, the base, 6, 
the number / of base-b digits, the minimum exponent é,j, and the maximum exponent @max. For 
double-precision numbers, b remains the same, but 1, @min, ANd @ngx are replaced by 7, Emin, ANd Enax- 


The 16 parameters discussed above are all integers and are obtained by invoking the function 
I1MACH with the appropriate argument. The floating-point single-precision and double-precision quan- 
tities provided by the functions RIMACH and DIMACH can be derived from the given integer quanti- 
ties, but are provided for efficiency and convenience. 


The single-precision floating-point quantities provided in RIMACH are the smallest positive magni- 
tude, pimin! the largest magnitude, b°™*(1—b~'), the smallest relative spacing between values, b~', 
the largest relative spacing between values, b“'~”, and the logarithm of the base 6, logiod. The relative 
spacing is | (y—x)/x |, when x and y are successive floating-point numbers. Equivalent values for the 
double-precision floating-point quantities are provided by DIMACH, with emin,s @max» and f replaced by 
Emviny Emax and T. 


Portable Random Number Generator 


In addition to the machine-dependent quantities, the PORT library was the source of the portable 
random number generator, UNI. UNI, written by Alan Gross, is a uniform generator which will pro- 
duce the same sequence of values, to the accuracy of the computer, on any computer with 16 or more 
bits. UNI is implemented as a FORTRAN function subprogram and returns a single real random vari- 
ate from the uniform [0,1) distribution. A complete listing of UNI is given in the Appendix. There 
are three local variables (FIRST, CSEED in UNI and TSEED in the routine RIUNIF) which must 
retain their most recently assigned values. In order to adhere to this requirement on a Data General 
Computer, the STATIC mode must be set when UNI is compiled. 


Program Readability 


In order to enhance the readability of the programs, two steps were taken. First, the authors were 
asked to precede each program unit with a specific comment structure. This structure was designed to 
allow the reader to easily identify a program unit. Second, the programs (except for 1.7, 1.8, and 5.1) 
were passed through the POLISH program [6]. POLISH was written at the University of Colorado at 
Boulder and is intended to improve and standardize the format of FORTRAN programs. It does this by 
renumbering all statement labels, by inserting CONTINUE statements to force every DO to end ona 
unique CONTINUE statement, and by systematically spacing and indenting each statement in the pro- 
gram. 
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Table 1 
machine-dependent quantity function (argument) 
standard input unit IIMACH (1) 
standard output unit IIMACH (2) 
standard punch unit IIMACH (3) 
standard error message unit IIMACH (4) 
number of bits per integer storage unit IIMACH (5) 
number of characters per integer storage unit IIMACH (6) 
base of an integer, a IIMACH (7) 
number of base a digits, s I1IMACH (8) 
largest integer, a°—1 ILMACH (9) 
base of a real number, b IIMACH (10) 
number of single-precision real base 6 digits, ¢ IIMACH (11) 
smallest single-precision real exponent, @nin ILMACH (12) 
largest single-precision real exponent, eax IIMACH (13) 
number of double-precision base 6 digits, T ILMACH (14) 
smallest double-precision exponent, Enin IIMACH (15) 
largest double-precision exponent, Eyx IIMACH (16) 
smallest positive real magnitude, pirin! RIMACH (1) 
largest positive magnitude, b°™*(1—b~) RIMACH (2) 
smallest relative spacing between values, b~' RIMACH (3) 
largest relative spacing between values, b‘'~”? RIMACH (4) 
logiob RIMACH (5) 
smallest positive double-precision magnitude, pFein—! DIMACH (1) 
largest positive double-precision magnitude, ohm (Jor) DIMACH (2) 
smallest relative spacing between double-precision values, b~" DIMACH (3) 
largest relative spacing between double-precision values, b''~”) D1MACH (4) 
double-precision, logi9 D1IMACH (5) 
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CHAPTER 1 


Fast Fourier Transform Subroutines 
J. W. Cooley and M. T. Dolan 


Introduction 


The following is but a small sample of the many excellent Discrete Fourier Transform (DFT) pro- 
grams which were offered for inclusion in this book. Each of the programs selected for the book has 
some particular virtue in terms of ease of use, understanding, and efficiency in specific applications. 
Preceding each subroutine, there is included documentation which should be sufficient to enable the 
user to apply it. Comment cards in the subroutine listings give brief descriptions of the arguments and, 
to some extent, a description of the internal operations of the subroutine. The write-ups are complete 
and self-sufficient, so it only remains, in this introduction, to make a few remarks designed to enable 
the user to select, from among the subroutines, the one appropriate for his particular application, and to 
enable him to use it effectively. As a further aid to the user, Tables 1 to 5 described in more detail 
below, give storage requirements, execution time, and accuracy of test calculations for all subroutines. 


FOUREA — A Short Demonstration Version of the FFT (1.1) 


The subroutine FOUREA, by C. Rader, and others like it [1] have been written primarily to 
describe and demonstrate the FFT algorithm, and to be used as models for writing efficient special- 
purpose or microprocessor programs. In general, such programs are not intended to be used as opera- 
tional programs. However, in some terminal-operated systems and interpreters, where the running 
time is less significant, these programs have been used effectively because they are short and easily 
understood. 


Fast Fourier Transform Algorithms (1.2) 


These efficient radix 2-4-8 subroutines, contributed by G. D. Bergland and M. T. Dolan, are written 
with a completely different objective. These are written to produce very fast programs at the expense 
of instruction memory and program complexity. The first DFT-IDFT pair, FAST-FSST, computes 
1024-point transforms of real data in about one-fourth the time of the previous program, FOUREA, 
but requires 1940 words of instruction store on the Honeywell 6080N versus only 260 for FOUREA. 
The programs FFA-FFS do exactly the same thing but include the use of radix 8 DFT’s internally and, 
as a result, run still faster, e.g., 134 ms. vs the 156 ms. for FAST-FSST for the 1024-point transform. 
The price for this is 3210 words vs 1940 words of instruction store. The third program in this package 
is FFT842, which computes the DFT of a complex input. For a 1024-point complex transform, this 
program takes 250 ms., which is almost twice as long as the time required for FAST. However, it is to 
be remembered that FAST and FFA do the calculation for real rather than complex input. Therefore, 
the amount of computing they do is a little more than half of that done by FOUREA and FFT842. 


FFT Subroutines for Sequences with Special Properties (1.3) 


The FFT subroutines for sequences with special symmetry properties by L. R. Rabiner are 
extremely useful for taking advantage of symmetries in the data to save computation. Such symmetries 
arise very often from the inherent nature of the data, such as in the case of the autocorrelation func- 
tion, which is always real and even. Cosine series with only odd harmonics appear in certain types of 
Chebyshev approximations and sine series with odd harmonics are useful in solving linear partial 
differential equations with boundary conditions calling for zero values on one end and zero derivatives 
on the other. These are written in the style of FOUREA, i.e., to be short and easily read. Sines and 
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cosines are computed as needed, rather than using tables, and calculations are done in "DO" loops 
without special cases for the simpler computations. The reason for this approach here is that a rela- 
tively insignificant amount of time is spent in the (1.3) subroutines; most of the time is spent in the 
DFT subroutine which is called internally. In the programs given here, the (1.3) subroutines call FAST 
and FSST but, it is to be emphasized that these calls may be replaced by calls to any other available 
DFT subroutines. For example, if N is not a power of two or if data is on some mass storage unit, one 
may want to use Singleton’s (1.4) or Fraser’s (1.5) FFT subroutines. 


The first four programs, FFTSYM, IFTSYM, FFTASM, and IFTASM, call FAST and FSST to com- 
pute what are actually cosine and sine transforms. Such programs have been generally available in pro- 
gram libraries. Some recent contributions to the DFT literature referred to in the write-up, have shown 
how to take advantage of further symmetries which correspond to the existence of only odd harmonics 
in the DFT. These novel ideas are incorporated in the subroutines whose names include the letters 
"OH", meaning "odd harmonics". For example, the subroutine FFTOHM computes the DFT of real 
data having a two-fold redundancy: the top half is equal to minus the bottom half. Thus, only N/2 data 
need be stored and internally, a DFT of only N/2 real points is computed. Thus, a saving by a factor 
of 2 in storage and almost a factor of 2 in computation results. The last four subroutines, whose names 
contain "SOH" and "AOH" use additional two-fold redundancies due to symmetry and anti-symmetry 
about 0 in the data. These result in still further reductions in storage and computing time. The com- 
puting times given in Tables 2a and 2b show that as N increases, one approaches a saving of a factor of 
2 for each two-fold redundancy in the data. If Nis not a power of 2, the subroutine call statements can 
be changed so as to call the mixed radix subroutines in the next sub-section. However, if N is not a 
power of 2, it must be a multiple of 4 for the first six subroutines and a multiple of 8 for the last four 
subroutines. 


Mixed Radix Fast Fourier Transforms (1.4) 


All of the above subroutines require that N be a power of 2, 4, or 8 since these are the simplest and 
most efficient forms of the FFT algorithm. The mixed radix FFT by R. C. Singleton permits one to use 
values of N containing other factors than 2. In general, the larger the prime factors of N, the less 
efficient will be the calculation in terms of numbers of operations per output point. 


Although the programs described above can be used for multidimensional transforms by simply 
computing the transforms for each vector of points in each dimension, the large number of subroutine 
calls would make this method quite inefficient. The second important feature of the mixed radix FFT 
is in the ease and efficiency with which it can be used for multidimensional complex and real 
transforms. One calls the subroutine once for each dimension and the subroutine computes the DFT 
for the number of points in that dimension, but, in the innermost loops, it repeats the calculation for 
all of the other dimensions, Table 2a shows that for powers of 2, FFT takes about the same amount of 
time as FFT842. The cost of the added flexibility is that FFT requires 2300 words of instruction 
storage while FFT842, with its subroutines, requires 1430. 


Optimized Mass Storage FFT Program (1,5) 


The sizes of the data arrays with which the above subroutines can be used depends, of course, upon 
the amount of core storage available. Depending upon the size of the machine, and the data arrays, it 
may sometimes be practical to keep the data array on a random access device such as a disk storage 
medium. The optimized mass storage FFT by D. Fraser makes this as easy and efficient as possible. 
The user defines the size of an available buffer store region of memory and provides subroutines which 
access the core storage where the data resides, The subroutine computes optimal size blocks and 
schedules the transfer of data between core storage and the mass storage medium in an optimal fashion 
according to algorithms which the author has designed and published. The array may have any number 
of dimensions and may be real or complex. The user will have to familiarize himself thoroughly with 
the documentation and will have to spend some effort on setting up read and write subroutines, but the 
result will be an extremely efficient program for very large Fourier transforms. If Nis not a power of 2 
or if one has two-dimensional arrays, then Singleton’s 2-dimensional mass-storage mixed radix FFT 
(1.9) may be preferable. 
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Chirp z-Transform Algorithm Program (1.6) 


The chirp z-transform program by L. Rabiner has been placed in this section because it is, in a 
sense, a generalization of a DFT. While the DFT may be regarded as an algorithm for evaluating the 
z-transform at N equidistant points on a unit circle, the chirp z-transform gives values of the z- 
transform at arbitrarily many equi-spaced points on an arbitrary spiral in the z-plane. In a sense, this is 
a generalized spectral analysis of discrete signals and plays the same role for discrete signals which the 
Laplace transform does in the case of continuous signals. The version given here uses FFT842 
described above, but, as with many other programs in this book, FFT842 may be replaced by any other 
appropriate DFT subroutine. 


Complex General-N Winograd Fourier Transform Algorithm (WFTA) (1.7) 


The complex general-N Winograd algorithm by J. H. McClellan and H. Nawab uses an algorithm 
which is quite different from the FFT. As far as the use is concerned, if N is a power of 2, a subrou- 
tine using the FFT algorithm should be used, but, if there are important reasons to have other factors 
in N there may be as much as a 40% improvement in running time over the mixed radix DFT (1.4), 
for some values of N. There is no consistent rule for describing ranges of N-values for which one or 
the other algorithm or program is better. One must consult the tables included in the write-up. The 
WFTA subroutine with its required subroutines take quite a large amount of instruction store, as com- 
pared with any of the FFT programs. In judging time-wise efficiency, one must also consider that an 
initialization routine must be run for an N-value before computing the DFT. Therefore, the WFTA 
subroutine is in general preferable only when a number of computations with the same N are to be 
done. 


Time-Efficient Radix-4 Fast Fourier Transform (1.8) 


The time-efficient radix-4 fast Fourier transform by L. R. Morris is an extreme example of trading 
off memory for time-wise efficiency when many DFT’s with the same N are to be performed. One is 
not likely to find this type of program in the usual program libraries, but since this situation is particu- 
larly typical in digital signal processing, it is regarded as a valuable contribution to this book. The pro- 
gram used here was produced by Morris’s Autogen technique, which has been described in the litera- 
ture. This technique essentially takes all data-independent parts of a given program, in this case, the 
radix-4 part of Singleton’s program above, puts them in a preprocessing stage and effectively unwinds 
some inner loops, making special cases of certain simple operations. This produces customized optimal 
code for special situations. After reviewing this example, the reader may be interested in further 
optimization by contacting the author to produce other optimized forms of signal processing programs 
using the Autogen technique. 


Two-Dimensional Mixed Radix Mass Storage Fourier Transform (1.9) 


The mass-storage mixed radix 2-dimensional DFT by R. C. Singleton is essentially an adaptation of 
his mixed radix program described above, to do what Fraser’s program does. The main differences are 
that the present program is slightly easier to use, it does not require the N to be a power of 2 and it 
requires less instruction store. However, it is limited in its utility to 2-dimensional arrays and may not 
be as optimal as Fraser's. 


Storage and Timing 


Table 1 contains a list of the user-called subroutines with sublists of the subroutines needed for 
each. Memory requirements are given for each subroutine along with totals for all subroutines needed 
by each user-called subroutine. These, of course, do not include storage required for data and other 
variables given as arguments in calling the subroutines. The run-totals include space for the sample cal- 
ling programs provided by the authors, data arrays, FFT subroutines, and system subroutines on the 
Honeywell 6080N. 


Tables 2a to 2d contain the average time in milliseconds for computing the transform and the 
inverse of the computed transform, starting with random sequences of length N=2", where 
m=1,2,...,15, with some of the user-level subroutines. Tables 3a to 3d contain the standard deviation 
about the mean running time of each program. One may interpret this as saying that the computing 
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time should differ from the given time by less than the standard deviation with a probability of 68%. 


Accuracy 


In Table 4, the average value, over several runs, of the difference between the initial random 
sequences and the result of computing the DFT and then the IDFT are given. Table 5 gives the stan- 
dard deviation of the errors used for Table 4. According to the analysis of Kaneko and Liu [1], the 
variance of the error in the DFT will be 


Oo} = H(m)oz , 0) 
where c? is the mean of the squares of the elements of a(n), n=0,1,...,N—1, and 
H(m) = 0.5(Sm—6)a2 + 0.25(25m?—51m+18)p2 (2) 


where m = log) Nand yu and a? are the mean and variance, respectively, of the rounding error. From 
the definition of the DFT used in this book, we have 02 = No?. 


The error in the IDFT will be the sum of two errors: one due to the error in the computed DFT and 
the other resulting from the IDFT calculation. The former error will be the IDFT of the DFT error 
8a(n) which, by Parseval’s rule, make an additive contribution o,/N to the variance of the error. The 
error produced by the IDFT calculation itself is given by a formula like that given above, except with 
the a’s replaced by x’s. Assuming independence of all errors, we get, for the variance of the resulting 
x()’s, 

ao}, = 2H(m)o?, (3) 
With o? = 1/3, this gives 
oi = (2/3)H(m) . (4) 


Assuming m to be moderately large, machines with proper rounding, i.e., with « = 0, will produce an 
error with a standard deviation of approximately 


os, = V5m/3 0, . (5) 

In machines which truncate instead of rounding, where » = 0, the term with « in H(m) dominates so 
that one obtains, approximately, 

Ox = + m, = 2mu (6) 


It can be seen in Tables 4 and 5 that the errors agree roughly with these estimates. 
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Table 1 


Memory Requirements on Honeywell 6080N 


with FORTRAN-Y Compiler 


“‘Run-Total”’ includes all the FFT subroutines, the main test as prepared by authors, 


and the system subroutines required to run on the Honeywell 6080N computer. 


“*Total’’ is the memory requirement for all the FFT subroutines in the package. 


“‘Subtotals’’ indicate memory necessary for independent subpackages, 


at FOUREA - A Short Demonstration Version of the FFT 
C. M. Rader 
Subroutine Name Words 
FOUREA 260 
Run-Total =10K Total= 260 
1.2 Fast Fourier Transform Algorithms 
G. D. Bergland and M. T. Dolan 
Subroutine Name Words 
FAST 220 
FSST 220 
FR2TR 50 
FR4TR 570 
FR4SYN 570 
FORD1 80 
FORD2 230 
FFA 260 
FFS 260 
R2TR 50 
R4TR 90 
R8TR 1060 
R4SYN 90 
R8SYN 1090 
ORD1 80 
ORD2 230 
FFT842 500 
R2TX 80 
R4TX 150 
R8TX 700 
Run-Total = 17K Total= 6580 
Subpackages Subtotals 
FAST, FSST,FR2TR,FR4TR,FR4SYN,FORD1 ,FORD2 1940 
FFA,FFS,R2TR,R4TR,R8TR,R4SYN,R8SYN,ORD1,ORD2 3210 
FFT842,R2TX,R4TX,R8TX 1430 
FAST,FR2TR,FR4TR,FORD1,FORD2 1150 
FSST,FR2TR,FR4SYN,FORD1,FORD2 1150 
FFA,R2TR,R4TR,R8TR,ORD1,ORD2 1770 
FFS,R2TR,R4SYN,R8SYN,ORD1,ORD2 1800 
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1.3 FFT Subroutines for Sequences with Special Properties 
L. R. Rabiner 
Subroutine Name Words 
FFTSYM 240 
IFTSYM 300 
FFTASM 210 
IFTASM 220 
FFTOHM 250 
IFTOHM 200 
FFTSOH 180 
IFTSOH 270 
FFTAOH 180 
IFTAOH 240 
FAST,FSST-Subpackage from 1,2 1940 
Run-Total =24K Total= 4230 
Subpackages Subtotals 
FFTSYM,FAST-Subpackage 1390 
IFTSYM,FSST-Subpackage 1450 
FFTSYM,IFTSYM,FAST-FSST-Subpackage 2480 
FFTASM,FAST-Subpackage 1360 
IFTASM,FSST-Subpackage 1370 
FFTASM,IFTASM,FAST-FSST-Subpackage 2370 
FFTOHM,FAST-Subpackage 1400 
IFTOHM, FSST-Subpackage 1350 
FFTOHM,IFTOHM,FAST-FSST-Subpackage 2390 
FFTSOH,FFTOHM, FAST-Subpackage 1580 
IFTSOH,IFTOHM, FSST-Subpackage 1620 
FFTSOH,IFTSOH, FFTOHM, IFTOHM, FAST-FSST-Subpackage 2840 
FFTAOH,FFTOHM,FAST-Subpackage 1580 
IFTAOH,IFTOHM,FSST-Subpackage 1590 
FFTAOH,IFTAOH,FFTOHM,IFTOHM,FAST-FSST-Subpackage 2810 
1.4 Mixed Radix Fast Fourier Transforms 
R. C, Singleton 
Subroutine Name Words 
FFT 350 
FFTMX 1690 
REALS 260 
REALT 370 
SORTG 340 
NORMAL 60 
RMS 110 
ISTKGT 110 
ISTKRL 150 
Run-Total =35K Total= 3440 
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Subpackages 


FFT,FFTMX,ISTKGT,ISTKRL-Subpackage 
FFT,FFTMX,ISTKGT,ISTKRL,REALS-Subpackage 
FFT,FFTMX,ISTKGT,ISTKRL,REALT-Subpackage 
FFT,FFTMX,ISTKGT,ISTKRL,REALS,REALT-Subpackage 


1.5 


1,6 


Optimized Mass Storage FFT 
D. Fraser 


Subroutine Name 
RMFFT 
CMFFT 
MFCOMP 
MFSORT 
MFREV 
MFLOAD 
MFINDX 
FMSUM 
MFRCMP 
MFRLOD 
MFPAR 
DMPERM 
RANMF 
NAIVE 
MFREAD 
MFWRIT 


Run-Total = 19K 


Chirp z-Transform Algorithm Program 
L. R. Rabiner 


Subroutine Name 
CZT 
RECUR 
DECUR 
FFT842-Subpackage from 1.2 


Run-Total = 17K 
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Total = 


Total = 


Subtotals 


3840 


2300 
2560 
2670 
2930 
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a7 Complex General-N Winograd Fourier Transform Algorithm (WFTA) 
J. H. McClellan and H. Nawab 


Subroutine Name 
INISHL 
CONST 
WFTA 
WEIAVE 
WEAVE2 


Run-Total =65K 


Words 
600 
600 

42470 

1280 
1480 


Total= 46430 


1.8 Time-Efficient Radix-4 Fast Fourier Transform 
L. R. Morris 
Subroutine Name Words 
RADIX4 6900 
RAD4SB 90 
Run-Total =21K Total= 6990 
1.9 Two-Dimensional Mixed Radix Mass Storage Fourier Transform 
R. C. Singleton 
Subroutine Name Words 
FFT2T 350 
FFT2I1 350 
XFR 40 
TRNSP 80 
EXCH 50 
MFREAD 50 
MFWRIT 40 
Run-Total =71K Total= 960 
Subpackages Subtotals 
FFT2T,XFR,TRNSP,MFWRIT,MFREAD,EXCH-Subpackage 610 
FFT21,XFR,TRNSP,MFWRIT,MFREAD,EXCH-Subpackage 610 
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N 


2 

4 

8 

16 

32 
64 
128 
256 
512 
1024 
2048 
4096 
8192 
16384 
32768 


FOUREA 
0.767 
1.510 
3.190 
6.790 

14.700 
31.200 
66.900 
143.000 
304.000 
649,000 
1380.000 
2900.000 
6090,000 
12900.000 
27200.000 


FFTSYM- 
IFTSYM 
0.225 
1.560 
2.170 
2.770 
4,380 
7.230 
13.300 
26,100 
52.300 
109.000 
223.000 
467.000 
971.000 
2040.000 
4230.000 


Table 2a 
Average Time in ms. 


FAST-FSST FFA-FFS 
1.020 0.998 
1,510 1.100 
1.810 1.740 
2.960 2.360 
4.820 4.110 
8.770 7.370 

17.400 14.500 
35.200 29.200 
75.000 60.900 
156,000 134.000 
339.000 282.000 
706.000 595.000 
1520,000 1290.000 
3180,000 2680.000 
6790.000 5680.000 

Table 2b 


Average Time in ms, 
Sequences with Special Properties 


FFTASM- 
IFTASM 
0.213 
1.450 
1.960 
2.500 
4.000 
6.450 
12.000 
23,200 
46.500 
97.400 
200.000 
421.000 
882.000 
1860.000 
3870.000 


FFTOHM- 
IFTOHM 
0.202 
1.480 
2.080 
2.760 
4.190 
6.950 
12.600 
24.700 
49.500 
103.000 
212.000 
445,000 
933.000 
1980.000 
4080.000 


1.0-9 


FFT842 
0.820 
1.060 
2.040 
3.370 
6.000 

12.000 
25,600 
52.600 

110.000 

250.000 

533.000 

1120.000 
2470.000 
5140.000 
10800.000 


FFTSOH- 
IFTSOH 
0.211 
0.225 
2.100 
2.910 
3.780 
5.840 
9.880 
17.900 
35.100 
69.800 
143.000 
286.000 
607.000 
1250.000 
2600.000 


FFT 
0.888 
1.100 
2.370 
3.110 
6.230 

11.800 

28.800 

54.700 

122.000 
261.000 
629.000 
1240.000 
2740.000 
5680.000 
12800.000 


FFTAOH- 
IFTAOH 
0.208 
0,219 
1.930 
2.680 
3.480 
5.430 
9.060 
16,700 
32.400 
64.800 
133.000 
266.000 
569.000 
1170.000 
2440.000 


FFTSUBS 
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Table 2c 
Average Time in ms. 
WFTA 
N Initial Subsequent 
4 1.540 0.838 
8 2.210 1.380 
16 3.980 2.450 
30 8.490 5.330 
60 16.400 9.890 
120 34.500 20.900 
240 81.700 47.700 
504 173.000 108.000 
1008 416.000 252.000 
2520 1040.000 728.000 
5040 2360.000 1670.000 
Table 2d 
Average Time in ms, 
Radix4 
N Initial Subsequent 
16 3.640 1.550 
64 13.500 7.180 
256 62.300 37.200 
1024 295.000 188.000 
Table 3a 
Standard Deviation in ms. 
N  FOUREA’ FAST-FSST FFA-FFS  FFT842 RET 
2 0.053 0.073 0.067 0.049 0.011 
4 0.026 0.090 0.043 0.016 0.016 
8 0.034 0.035 0.043 0.120 0,066 
16 0.084 0.084 0.046 0.046 0.061 
32 0.076 0.051 0.152 0.094 0.028 
64 0.079 0.048 0.128 0.159 0.029 
128 0.130 0.009 0.034 0.043 0.059 
256 0.129 0.032 0.020 0.131 0.100 
512 0,869 0.152 0.158 0.587 1.000 
1024 1.740 0.401 0.170 1.300 0.694 
2048 6.790 0.994 0.728 3.030 2.560 
4096 48.400 8.750 7.150 16.400 16.400 
8192 48.500 12.300 7.240 14.000 13.200 
16384 105.000 11.700 27.400 41.200 19.400 
32768 551.000 27.100 10.800 98.200 152.000 
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Table 3b 
Standard Deviation in ms. 
Sequences with Special Properties 


N  FFTSYM- FFTASM- FFTOHM- FFTSOH- FFTAOH- 
IFTSYM IFTASM IFTOHM IFTSOH IFTAOH 


2 0.006 0.012 0.006 0.005 0.006 
4 0.070 0.079 0.030 0.018 0.007 
8 0.045 0.031 0.034 0.096 0.041 
16 0.038 0.043 0.126 0.139 0.096 
32 0,055 0,131 0,045 0,158 0.076 
64 0.061 0.056 0.092 0.062 0.067 
128 0.045 0.186 0.026 0.091 0.060 
256 0.089 0.042 0.035 0.035 0.120 
512 0.162 0.045 0.053 0,144 0.065 
1024 0.257 0.170 0.163 0.111 0.156 
2048 0.138 1.730 0.258 0.185 0.413 
4096 4.800 4.460 4.230 2.760 0.319 
8192 9.510 10.600 11.300 6.030 6.070 
16384 17.000 16.800 3.680 4.460 9.620 
32768 45.500 29.600 29.000 26.400 28.400 

Table 3c 

Standard Deviation in ms. 
WFTA 


N_ Initial Subsequent 
4 0.197 0.049 
8 0.023 0.161 
16 0,051 0.029 
30 =: 0.092 0.051 
60 0,292 0,139 
120 0.441 0.173 
240 0.863 0.413 
504 1.450 1.130 
1008 = 3,630 1,670 
2520 7.120 4.380 
5040 11.000 6,350 


Table 3d 
Standard Deviation in ms. 
Radix4 


N Initial Subsequent 
16 0.048 0.029 
64 = (0,167 0.085 
256 0.819 0.446 
1024 3.000 1.500 
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N FOUREA 
Ph Mie 

4  0.72164E-15 
8 0.66613E-15 
16 0.37331E-14 
32 0.13850E-13 
64 0.26326E-13 
128 0.46768E-13 
256 0.30520E-12 
512 0,44593E-12 
1024 0.89891E-12 

2048 =0.1711SE-11 

4096 0.36367E-11 
8192 0.92585E-11 
16384 0.25433E-10 
32768 0.45252E-10 


N FOUREA 
eye att 
4  0.23264E-07 

8  0.15805E-07 

16 0,26457E-07 

32 0.36034E-07 

64 0.35128E-07 
128 0.33108E-07 
256 0,59805E-07 
512 0.51116E-07 
1024 —0,51318E-07 
2048 —-0.50071E-07 
4096 0.51610E-07 
8192 0.58229E-07 
16384 0.68241E-07 
32768 —0.64366E-07 


Table 4 
Sum of Squares Error 


FAST-FSST FFA-FFS FFT842 

0. 0. 0. 
0.88818E-15 0.18128E-15 0.27756E-15 
0.19429E-15  0.30618E-15 0.11241E-14 
0.21272E-15 0.18501E-14 0.70499B-14 
0.91221E-14 0.47967E-14 0.13177E-13 
0.78466E-14 0.19558E-13 0.32644E-13 
0.28238E-13  0.61767E-13  0.68565E-13 
0.18360E-12 0.50912E-13 0.11421E-12 
0.15395E-12 0.20711E-12 0.26937E-12 
0.34031E-12 0.35218E-12 0.62708E-12 
0.61706E-12 0.61415E-12  0.13545E-11 
0.19966E-11 0.2031S5E-11 0.50954E-11 
0.40613E-11 0.56809E-11 0.12832E-10 
0.14997E-10 0.95540E-11 0.17858E-10 
0.20410E-10 0.25955E-10 0.33980E-10 


Table 5 
Standard Deviation of Error 


FAST-FSST FFA-FFS FFT842 


0. 0. 0. 

0.25810E-07 0.11660E-07 0.14428E-07 
0.85357E-08 0.10715E-07 0.20531E-07 
0.63155E-08 0,18625E-07 0.36357E-07 
0.29244E-07 0.21206E-07 0.35147E-07 
0.19178E-07 0.30278E-07 0.39118E-07 
0.25726E-07 0.38048E-07 0.40087E-07 
0.46385E-07 0.24426E-07 0.36584E-07 
0.3003SE-07 0.34836E-07 0.39728E-07 
0.31575E-07 0.32121E-07 0.42862E-07 
0.3006SE-07 0.29994E-07 0.44544E-07 
0.38241E-07 0.38574E-07 0.61090E-07 
0.38565E-07 0.45611E-07 0.68552E-07 
0.52403E-07 0.41826E-07 0,57184E-07 
0.43227E-07 0.48747E-07 0.55776E-07 


1.0-12 


FFT 


0. 

0.40246E-15 
0.8465SE-15 
0.36533E-14 
0.92981E-14 
0.62922E-13 
0.74431E-13 
0.24460E-12 
0.55185E-12 
0.14303B-11 
0.36801E-11 
0.82930E-11 
0.14287E-10 
0.33178E-10 
0.86588E-10 


FFT 

0. 

0.17374E-07 
0.17817E-07 
0.26172E-07 
0.2952SE-07 
0.54309E-07 
0.41767E-07 
0.53539E-07 
0.56863E-07 
0.64734E-07 
0.73422E-07 
0.77936E-07 
0.72333E-07 
0.77942E-07 
0.89036E-07 
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FOUREA - A Short Demonstration Version of the FFT 


C. M. Rader 


MIT Lincoln Laboratory 
Lexington, MA 02173 


1. Purpose 


This program can be used to evaluate the discrete Fourier transform (DFT), 
{X(k); k=0,1,....N—1}, of an N point sequence of complex numbers, (x(n); n=0,1,...,.V—1}, where N 
must be a power of two, N = 2™. It can also evaluate the inverse DFT. The DFT of (x(n)} is defined 
as 


N=1 aya 
Xk) = J x(Me Xs k=0,1,...N—1 (1) 
n=O 
The inverse DFT is defined as 
N=I = 
x)= EE KES n= OMNI Q) 
k=0 


Unlike other programs in this collection, FOUREA is not highly recommended for actual use, Other 
programs are provided which compute the DFT for more diverse values of N, for multidimensional 
sequences, and with shorter running time. FOUREA is intended mainly for educational and demons- 
tration purposes. 


2. Method 


The program, which expects the input to be a complex array, is an implementation of the radix-2 
Cooley-Tukey algorithm [1]. The input is first rearranged into "bit-reversed" order by the DO 80 loop, 
then log, stages of "butterflies" are performed by statements 90 to 130. The computation is per- 
formed "in-place". The internal data structure is represented by Fig. 5 of Ref. 2. 


3. Usage 
The program consists of a subroutine, FOUREA, called by 


CALL FOUREA (DATA,N,ISIGN). 


DATA is the name of an array of N complex numbers (or 2N real numbers, in which case 
DATA(2 * I-1) + jDATA(2 * I) is treated as a complex number.) 


N is the length of the sequence being transformed and must be a power of two. 


ISIGN is an integer which should be —1 to compute the DFT defined by Eq. (1). If ISIGN is 
+1 , Eq. (2) is used to compute the inverse DFT. Note that the normalization by N is 
included. 


The array DATA serves as both the input array and the output array, e.g., before the call to FOUREA, 
DATA holds the sequence to be transformed, whereas after the call it holds the transform. The index- 
ing is displaced such that x(n) is stored in array location n + 1 and X(k) is in array location k + 1. 
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4. Test Problem 


To test any DFT program, several approaches are available. We have chosen to compare the output of 
FOUREA with the predicted DFT of a sequence whose DFT has a simple algebraic form. The 
sequence we are using is 


x(n)=Q" n=0,1,..,.N—1 (3) 
and its DFT is 
X(k) = (1-0")/(-OW*) kk = 0,1,...,N-1 (4) 
where 
2m 
W=e uN 


and Q is the complex constant 0.9 + /0.3. In the test we use N = 2°. The test program computes and 
prints out {x(n)}, using Eq. (3), and {X(k)}, first using FOUREA and then using Eq. (4). Next, 
{x(n)}, computed as the inverse DFT of Eq. (4) using FOUREA, is printed. Finally the program 
prints the maximum absolute difference between {X(k)} and the computed DFT of Eq. (3), and 
between (x(n)} and the computed inverse DFT of Eq. (4). These differences should be small com- 
pared to unity -- otherwise the program has failed. The test was run on a Honeywell 6080N computer 
in the example reproduced in Table 1. 
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Table 1 


COMPLEX INPUT SEQUENCE 
( 1) 0,100000E 01 0. 
3) 0.720000E 00 0.540000E 00 
5) 0.226800E 00 0.777600E 00 
7) -0.256608E 00 0.682344E 00 
9) -0,.553224E 00 0.352719E 00 
11) -0,588789E 00 -0.4478285-01 
13) -0.399746E 00 -0.350190E 00 
15) -0.987144E-01 -0.467999E 00 


0.900000E 00 0.300000E 00 
( 0 
( 
( 
( 
( 
( 
( 
(17) 0.181645E 00 -0.390265E 00 
( 
( 
( 
( 
( 
( 
( 


2) 

4) .486000E 00 0.702000E 00 
6) -0.291600E-01 0.767880E 00 
8) -0.435650E 00 0.537127E 00 
10) -0.603717E 00 0.151480E 00 
12) -0.516476E 00 -0.216941E 00 
14) -0.254714E 00 -0.435095E 00 
16) 0.515569B-01 -0,450814E 00 
0.280560E 00 -0.296745E 00 
20) 0.362246E 00 -0.621539E-01 
22) 0.294380E 00 0.150862E 00 
24) 0.130488E 00 0.267586 00 
26) -0,505448E-01 0.263125E 00 
28) -0.178480E 00 0.162156E 00 
30) -0.216070E 00 0.203732E-01 
32) -0.166572E 00 -0.102009E 00 


19) 0.341528B 00 -0.182903E 00 
21) 0.344667E 00 0.527352E-01 
23) 0.219684E 00 0.224090E 00 
25) 0.371637E-01 0.279974E 00 
27) -0.124428E 00 0.221649E 00 
29) -0,209279E 00 0.923965E-01 
31) -0.200575E 00 -0.464851E-01 


o 


UREA DFT 
1) 0,.693973E 00 0.349972E 01 
3) 0.940296E 01 -0.913501E 01 
5) 0.113182E 01 -0.223416E 01 
7) 0.799557E 00 -0.113961E 01 
9) 0.700862E 00 -0.698565E 00 
11) 0.653109E 00 -0.446245E 00 


{0) 

( 2) 0.279227E 01 0,805046E 01 
\h 

( 

( 

( 13) 0.623788E 00 -0,272086E 00 
( 

i 

( 

( 

( 

( 

( 

( 

( 


4) 0.186645E .~383383E 01 
6) 0.904794E 00 -0.153463E 01 
8) 0.739606E 00 -0.882314E 00 
10) 0.673576E 00 -0.558478E 00 
12) 0.636991E 00 -0.352689E 00 
14) 0.612613E 00 -0.200642E 00 
16) 0.594200E 00 -0.753136E-01 
18) 0.578900E 00 0.376517E-01 
20) 0.565136E 00 0.147983E 00 
22) 0.551859E 00 0.264522E 00 
24) 0.538214E 00 0.398257E 00 

Oo. 

0. 


15) 0.602883E 00 -0.135703E 00 
17) 0.586277E 00 -0.179492E-01 
19) 0.571899E 00 0.926070E-01 
21) 0.558492E 00 0.204881E 00 
23) 0,545134E 00 0.328365E 00 
25) 0.531002E 00 0.476678E 00 
27) 0,515362E 00 0.674850E 00 
29) 0.498467E 00 0.980906E 00 
31) 0,490732E 00 0.157708E 01 


26) 0.523404E 00 567132E 00 
28) 0,506926E 00 808101E 00 
30) 0.491389E 00 0.121921E 01 
32) 0.517354E 00 0.218883E 01 


1.1-2 


Section 1.1 


THEORETICAL DFT 


( 


( 
( 
ij 
( 
: 
( 
( 
( 
( 
( 
( 
( 
( 
( 


FOUREA 


29) 
31) 


0.693973E 
0.940296E 
0.113182E 
0.799557E 
0,.700862E 
0.653109E 
0,623788E 
0.602883E 
0.586277E 
0.571898E 
0.558492E 
0.545134E 
0.531002E 
0.515362E 
0.498467E 
0.490732E 


INVERSE DFT 


0.100000E 
0.720000E 
0.226800E 
-0,.256608E 
-0,553224E 
-0.588789E 
-0,399746E 


-0.987144E- 


0.181645E 
0.341528E 
0.344667E 
0.219684E 


0.371637E- 


-0.124428E 
-0.209279E 
-0.200575E 


00 
01 
01 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 


01 
00 
00 
00 
00 
00 
00 
01 
00 
00 
00 
00 
01 
00 
00 
00 
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(Continued) 


0.349972E 01 
-0.913501E 01 
-0.223416E 01 
-0.113961E 01 
-0.698565E 00 
-0.446245E 00 
-0.272086E 00 
-0.135703E 00 
-0.179492E-01 
0.926070E-01 
0.204881E 00 
0.328365E 00 
0.476678E 00 
0.674850E 00 
0.980906E 00 
0.157708E 01 


0.372529E-08 
0.540000E 00 
0.777600E 00 
0,682344E 00 
0.352719E 00 
-0,447828E-01 
-0.350190E 00 
-0.467999E 00 
-0.390265E 00 
-0.182903E 00 
0.527352E-01 
0.224090E 00 
0.279974E 00 
0.221649E 00 
0.923965E-01 
-0.464851E-01 


30) 
32) 


MAX DIFF BETWEEN THEOR AND FOUREA DFT IS 


MAX DIFF BETWEEN ORIGINAL DATA AND INVERSE DFT IS 


0.279227E 01 0.805046E 01 
0.186645E 01 -0.383383E 01 
0,904794E 00 -0.153463E 01 
0.739606E 00 -0.882314E 00 
0.673576E 00 -0.558478E 00 
0.636991E 00 -0.352689E 00 
0.612613E 00 -0.200642E 00 
0,594200E 00 -0.753137E-01 
0.578900E 00 0.376517E-01 
0.565136E 00 0.147983E 00 
0.551859E 00 0.264522E 00 
0.538214E 00 0.398257E 00 
0.523404E 00 0.567132E 00 
0.506926E 00 0.808101E 00 
0.491389E 00 0,121921E 01 
0.517354E 00 0.218883E 01 


0.900000E 00 0.300000E 00 
0.486000E 00 0.702000 00 
-0.291600E-01 0.767880E 00 
-0.435650E 00 0.537127E 00 
-0.603717E 00 0.151480E 00 
-0.516476E 00 -0.216941E 00 
-0.254714E 00 -0.435095E 00 
0.515569E-01 -0.450814E 00 
0.280560E 00 -0.296745E 00 
0.362246E 00 -0.621539E-01 
0.294380E 00 0.150862E 00 
0.130488E 00 0.267586E 00 
-0.505448E-01 0.263125E 00 
-0.178480E 00 0.162156E 00 
-0.216070E 00 0,.203732E-01 
-0.166572E 00 -0.102009E 00 


0.238E-06 
0.263E-07 
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Fast Fourier Transform Algorithms 


G. D. Bergland and M. T. Dolan 
Bell Laboratories 
Murray Hill, NJ 07974 


1, Purpose 

Fast Fourier analysis and fast Fourier synthesis algorithms are presented for computing both the 
discrete Fourier transform (DFT) of a real or complex sequence and the inverse DFT (IDFT) of a 
complex sequence. 
2. Method 
2.1 DFT (Real Input Sequence) 

The subroutines FAST (radix 4-2) and FFA (radix 8-4-2) evaluate the equation 

N=1 —j2% nk 
X(k) = Dxlne % (a) 


n=0 


where x(n) is real, X(k) is complex, and k=0,1,...,V/2. Only (N/2+1) complex DFT values need be 
computed and stored because x() is real and by symmetry 


X(N-k)=X(k) (2) 
for k=0,1,...,N/2 and * denoting the complex conjugate. 


The algorithms preserve the order and symmetry of the original Cooley-Tukey algorithm [1] but 
eliminate the operations which are redundant for real series, thus effecting a two-to-one reduction in 
the calculations and storage requirements [2]. 


The radix 8-4-2 routine performs as many base 8 iterations as possible and then performs one base 4 
or a base 2 iteration, if necessary. Similarly, the radix 4-2 routine performs as many base 4 iterations as 
possible and then performs one base 2 iteration, if necessary. Thus, they can be used for any value of 
Nwhich is an integral power of 2. 


2.2. DFT (Complex Input Sequence) 


The subroutine FFT842 (radix 8-4-2) evaluates (1) for a complex input sequence 
x(n), 0<n<N-1, and for 0<k<N-—1. With N factored into powers of 8, 4, and 2, the summed pro- 
ducts are computed iteratively very efficiently by using equations which extend the recursive equations 
of the Cooley-Tukey algorithm [3,4]. 


2.3 Inverse DFT (Real Output Sequence) 
The subroutines FSST (radix 4-2) and FFS (radix 8-4-2) evaluate the equation 
y Nc j27nk 
x(n=—¥ X(ke % (3) 
N k=0 


for n=0,1,...,.N—1. 


These subroutines use the fact that ¥(k) has complex conjugate symmetry around k=N/2 in order 
to evaluate (3) in an efficient manner from the (N/2+1) complex values of X(k). 
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Effectively, these inverse algorithms are a specialization of the Sande-Tukey algorithm [5]. They are 
further characterized, as are all the algorithms, by performing in-place reordering and having no stored 
tables of sines or cosines. 


2.4 Inverse DFT (Complex Output Sequence) 
FFT842 computes the the inverse DFT by using the relationship 


(4) 


N-1 o PE nk 
Exe 8" 
k=0 


x(n=t 


for n=0,1,...,N—1 and * denoting the complex conjugate operation. Thus to compute an inverse DFT, 
the sequence X(k) is complex conjugated, a direct DFT is taken, and the resulting output is complex 
conjugated and normalized by the factor 1/N. 


3. Usage 
3.1 For a DFT (Real Input Sequence X) 


CALL FAST(X,N) (radix 4-2) 
or 
CALL FFA(X,N) (radix 8-4-2) 
where 


X Real array dimensioned to size N+2. On input, X contains the N-point sequence to be 
transformed (stored in locations 1 to N) and on output, X contains the (N/2+1) complex values 
of the transform. On output, the real components are stored in the odd locations of the array and 
the imaginary components are stored in the even locations. 


N__ Size of the input sequence. N must be a power of 2 and 2 < N <2". 
3.2 For a DFT (Complex Input Sequence X) 


CALL FFT842(IN,N,X,Y) (radix 8-4-2) 
where 


IN Input parameter set to 0 for a DFT. 
N__ Size of the input sequence. N must be a power of 2 and 2 < N < 2". 


X Real array dimensioned to size N. On input, X contains the real components of the sequence to 
be transformed. On output, X contains the real components of the transform. On input and out- 
put, the N values of X are stored in locations 1 to N. 


Y Real array dimensioned to size N. On input, Y contains the imaginary components of the 
sequence to be transformed. On output, Y contains the imaginary components of the transform. 
On input and output, the N values of Y are stored in locations 1 to N. 


3.3 For an Inverse DFT (Real Output Sequence X) 


CALL FSST(X,N) (radix 4-2) 
or 
CALL FFS(X,N) (radix 8-4-2) 
where 


X Real array dimensioned to size N+2. On input, X contains the (N/2+1) complex values of the 
transform with the real components stored in the odd locations of the array and the imaginary 
components stored in the even locations. On output, X contains the sequence x(n), O0<n<N-1, 
stored in locations 1 to N. 


N __ Size of the sequence. N must be a power of 2 and 2 < N < 2". 
3.4 For an Inverse DFT (Complex Output Sequence X) 


CALL FFT842(IN,N,X,Y) (radix 8-4-2) 
where 
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IN 


4, 


Input parameter set to 1 for an inverse DFT. 
Size of the sequence. N must be a power of 2 and 2 < N < 2! 
Real array dimensioned to size N. On input, X contains the real components of the direct 
transform. On output, X contains the real components of the inverse. On input and output, the 
N values of X are stored in locations 1 to N. 
Real array dimensioned to size N. On input, Y contains the imaginary components of the direct 
transform. On output, Y contains the imaginary components of the inverse. On input and out- 
put, the N values of Y are stored in locations | to N. 

Tests 


The complete FAST-FSST package includes: 
FAST and FSST (executive routines for DFT and IDFT) 
FR2TR and FR4TR (radix 2 and radix 4 iteration routines) 
FR4SYN (radix 4 synthesis routine) 
FORD1 and FORD? (in-place reordering routines) 


The complete FFA-FFS package includes: 
FFA and FFS (executive routines for DFT and IDFT) 
R2TR, R4TR, and R8TR (radix 2, 4, and 8 iteration routines) 
R4SYN and R8SYN (radix 4 and 8 synthesis routines) 
ORD1 and ORD2 (in-place reordering routines) 


The complete FFT842 package includes: 
FFT842 (executive routine for both DFT and IDFT) 
R2TX, R4TX, and R8TX (radix 2, 4, and 8 iteration routines) 


The test program can be used to check out the three packages of code. The same 32-point real 


sequence of random numbers is used as data for each package. The random numbers are from a uni- 
form distribution as generated by UNI (see Standards Section). The DFT and the inverse DFT are 
printed. In addition, a complex sequence of random numbers is used as input to FFT842. Complete 
output from the test program is in Table 1. 


5. 


The three packages of code and the test program appear in the Appendix. 
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Table 1 


TEST FAST AND FSST 


REAL INPUT SEQUENCE 
0.22925607E 00 0.76687502E 00 0.68317685E 00 0.50919111E 00 
0.87455959E 00 0.64464101E 00 0.84746840E 00 0.35396343E 00 
0.39889160E 00 0.45709422E 00 0.23630936E 00 0.13318188E 00 
0.16605222E 00 0.22602680E 00 0 .66245903E 00 0.25021175E 00 
0.61769668E 00 0.26246527E 00 0.51266762E 00 0.93920734E 00 
0.62402816E 00 0 .42238195E 00 0.93970599E 00 0.28206823E 00 
0.46921754E 00 0.54879178E-01 0.51983086E 00 0.39682690E 00 
0.11315656E 00 0.60751725E 00 0.70150672E 00 0.88705479E 00 


REAL COMPONENTS OF TRANSFORM 
0.15789569E 02 0.13026034E 01 0.11936771E 01 0.40612735E-01 
-0.46179910E 00 0.70122853E-01 -0.27579353E 00 0.46209661E 00 
~0,.16102664E 01 -0.14930917E 01 0.21015245E 00 -0.93344460E 00 
0.33632980E 00 -0.12900518E 01 -0.12126616E 01 -0.12663724E 01 
0.14023971E 01 


IMAG COMPONENTS OF TRANSFORM 
o. 0.19871481E 00 -0.28999118E 01 0.72163936E 00 
0.13081519E 01 -0.15931014E-01 0.10351044E 01 0.11709984E-01 
0.30982471E 00 -0.87044477E 00 -0.18331044E 00 -0.55190805E-01 
-0.10901590E 01 0.18219048E 01 0.75918928E 00 -0.10652235E 00 
0. 


REAL INVERSE TRANSFORM 
0.22925607E 00 0.76687504E 00 0.68317685E 00 0.50919111E 00 
0.87455960E 00 0.64464101E 00 0.84746840E 00 0.35396343E 00 
0.39889160E 00 0.45709423E 00 0.23630936E 00 0.13318189E 00 
0.16605222E 00 0.22602681E 00 0.66245903E 00 0.25021176E 00 
0.61769669E 00 0.26246528E 00 0.51266762E 00 0.93920734E 00 
0.62402817E 00 0.42238196E 00 0.93970599E 00 0.28206824E 00 
0.46921754E 00 0.54879181E-01 0,51983087E 00 0.39682690E 00 
0.11315656E 00 0.60751726E 00 0.70150672E 00 0.88705480E 00 


TEST FFA AND FFS 


REAL INPUT SEQUENCE 
0.22925607E 00 0.76687502E 00 0.68317685E 00 0.50919111E 00 
0.87455959E 00 0.64464101E 00 0.84746840E 00 0.35396343E 00 
0.39889160E 00 0.45709422E 00 0.23630936E 00 0.13318188E 00 
0.16605222E 00 0.22602680E 00 0.66245903E 00 0.25021175E 00 
0.61769668E 00 0.26246527E 00 0.51266762E 00 0.93920734E 00 
0.62402816E 00 0.42238195E 00 0.93970599E 00 0.28206823E 00 
0.46921754E 00 0.54879178E-01 0.51983086E 00 0.39682690E 00 
0.11315656E 00 0.60751725E 00 0.70150672E 00 0.88705479E 00 


REAL COMPONENTS OF TRANSFORM 
0.15789569E 02 0.13026034E 01 0.11936771E 01 0.40612705E-01 
-0.46179910E 00 0.70122856E-01 -0.27579353E 00 0.46209661E 00 
-0.16102664E 01 -0.14930917E 01 0.21015245E 00 -0.93344463E 00 
0,33632980E 00 -0.12900518E 01 -0.12126616E 01 -0.12663724E 01 
0.14023971E 01 


IMAG COMPONENTS OF TRANSFORM 
0. 0.19871481E 00 -0.28999118E 01 0.72163937E 00 
0.13081519E 01 -0.15931029E-01 0.10351044E 01 0.11709988E-01 
0.30982471E 00 -0.87044477E 00 -0.18331045E 00 -0.55190814E-01 
-0.10901590E 01 0.18219048E 01 0.75918928E 00 -0.10652235E 00 
0. 


REAL INVERSE TRANSFORM 
0.22925607E 00 0.76687504E 00 0.68317685E 00 0.50919111E 00 
0.87455960E 00 0.64464102E 00 0.84746840E 00 0.35396344E 00 
0.39889160E 00 0.45709423E 00 0,23630936E 00 0.13318189E 00 
0.16605222E 00 0.22602680E 00 0.66245904E 00 0,25021175E 00 
0.61769669E 00 0.26246528E 00 0.51266762E 00 0.93920734E 00 
0.62402817E 00 0.42238196E 00 0.93970599E 00 0.28206824E 00 
0.46921754E 00 0.54879183E-01 0.51983087E 00 0.39682691E 00 
0.11315656E 00 0.60751726E 00 0.70150673E 00 0.88705480E 00 
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Table 1 
(Continued) 
TEST FFT842 WITH REAL INPUT SEQUENCE 


REAL COMPONENTS OF INPUT SEQUENCE 
0.22925607E 00 0.76687502E 00 0.68317685E 00 0.50919111E 00 
0.87455959E 00 0.64464101E 00 0.84746840E 00 0.35396343E 00 
0.39889160E 00 0.45709422E 00 0.23630936E 00 0.13318188E 00 
0.16605222E 00 0.22602680E 00 0,66245903E 00 0.25021175E 00 
0.61769668E 00 0.26246527E 00 0.51266762E 00 0.93920734E 00 
0.62402816E 00 0.42238195E 00 0.93970599E 00 0.28206823E 00 
0.46921754E 00 0.54879178E-01 0.51983086E 00 0.39682690E 00 
0.11315656E 00 0.60751725E 00 0.70150672E 00 0.88705479E 00 


IMAG COMPONENTS OF INPUT SEQUENCE 


oO. o. oO. 0. 
0. oO. 0. 0. 
0. 0. 0. oO. 
oO. Oo. oO. 0. 
0. 0. 0. oO. 
0. 0. oO. 0. 
0. 0. 0. 0. 
0. 0. oO. 0. 


REAL COMPONENTS OF TRANSFORM 
0.15789569E 02 0.13026034E 01 0.11936771E 01 0.40612735E-01 
-0.46179911E 00 0.70122864E-01 ~-0.27579352E 00 0.46209662E 00 
-0.16102664E 01 -0.14930917E 01 0,21015245E 00 -0.93344462E 00 
0.33632981E 00 ~-0.12900518E 01 -0.12126616E 01 -0.12663724E 01 
0.14023971E 01 -0.12663724E 01 -0.12126616E 01 -0.12900518E 01 
0.33632981E 00 ~-0.93344463E 00 0.21015244E 00 -0.14930917E 01 
-0.16102664E 01 0.46209661E 00 -0.27579353E 00 0.70122849E-01 
-0.46179910E 00 0.40612698E-01 0.11936771E 01 0.13026034E 01 


IMAG COMPONENTS OF TRANSFORM 
0. 0.19871481E 00 -0.28999118E 01 0.72163936E 00 
0.13081520E 01 -0.15931033E-01 0.10351044E 01 0.11709969E-01 
0.30982471E 00 -0,87044477E 00 -0.18331045E 00 ~-0.55190805E-01 
-0.10901590E 01 0.18219048E 01 0.75918929E 00 -0.10652234E 00 
0. 0.10652235E 00 -0.75918928E 00 -0.18219048E 01 
0.10901590E 01 0.55190824E-01 0.18331043E 00 0.87044481E 00 
-0.30982471E 00 -0.11709984E-01 -0,10351044E 01 0.15931014E-01 
-0.13081520E 01 -0.72163937E 00 0.28999118E 01 -0.19871484E 00 


REAL COMPONENTS OF INVERSE TRANSFORM 
0.22925607E 00 0.76687504E 00 0.68317685E 00 0.50919111E 00 
0.87455961E 00 0.64464103E 00 0.84746840E 00 0.35396344E 00 
0.39889160E 00 0.45709423E 00 0.23630936E 00 0.13318189E 00 
0.16605222E 00 0.22602681E 00 0.66245903E 00 0.25021176E 00 
0.61769669E 00 0.26246528E 00 0.51266762E 00 0.93920734E 00 
0.62402817E 00 0.42238197E 00 0.93970599E 00 0.28206823E 00 
0.46921754E 00 0 .54879185E-01 0.51983087E 00 0.39682690E 00 
0.11315656E 00 0.60751726E 00 0.70150672E 00 0.88705480E 00 


IMAG COMPONENTS OF INVERSE TRANSFORM 
0.18626452E-08 0.74943591E-09 -0.45625189E-09 -0.12955597E-08 
-0.65688967E-09 -0.21652834E-08 -0.13654090E-08 0.58739834E-09 
-0.27939677E-08 -0.26120810E-08 -0.94073198E-09 0.37602551E-08 
0.21702889E-08 0.16996221E-08 0.24131469E-08 -0.49095674E-09 
0.18626452E-08 0.74943591E-09 0.14063933E-08 -0.68834951E-08 
-0.18210429E-08 -0.30263824E-09 -0.66691706E-09 0 .58739834E-09 
-0.93132258E-09 0,11132092E-08 -0.18720546E-08 0.37602551E-08 
0 .30764370E-09 0.76829952E-09 0.14818243E-08 -0.25295450E-10 


TEST FFT842 WITH COMPLEX INPUT SEQUENCE 


REAL COMPONENTS OF INPUT SEQUENCE 
0,22925607E 00 0.76687502E 00 0,68317685E 00 0.50919111E 00 
0.87455959E 00 0.64464101E 00 0.84746840E 00 0.35396343E 00 
0.39889160E 00 0.45709422E 00 0.23630936E 00 0.13318188E 00 
0.16605222E 00 0.22602680E 00 0.66245903E 00 0.25021175E 00 
0.61769668E 00 0.26246527E 00 0.51266762E 00 0.93920734E 00 
0.62402816E 00 0.42238195E 00 0.93970599E 00 0.28206823E 00 
0.46921754E 00 0.54879178E-01 0.51983086E 00 0.39682690E 00 
0.11315656E 00 0.60751725E 00 0.70150672E 00 0.88705479E 00 
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(Continued) 


IMAG COMPONENTS OF INPUT SEQUENCE 


0.33143324E 
0.36706980E 
0.13391190E 
0.98293080E 
0 .82732023E 
0.72906453E 
0.38462142E 
0.51983388E 


00 
00 
00 
00 
00 
00 
00 
00 


0.22096146E 
0.49780032E 
0.11614336E 
0.78848629E 
0.10252799E 
0.72203852E 
0.96184775E 
0.76180377E 


REAL COMPONENTS OF TRANSFORM 


0.15789569E 
-0.91315009E 
-0.20202583E 
-0.39671516E 
0.14023971E 
0.10693748E 
-0.12002746E 


-0.10448134E-' 


02 
00 
01 
00 
01 
01 
01 
01 


0.54187694E 
-0.15766885E 
-0.60150058E 
0.22274646E 
-0.23689694E 
-0.17185353E 
0.71695102E 
-0.32908173E 


IMAG COMPONENTS OF TRANSFORM 


0.16498260E 
-0.95682339E 
0.11171471E 
-0.66840816E 
-0.10081615E 
0.15119098E 
0.49749768E 
-0.35731273E 


02 
00 
01 
00 
01 
01 
00 
01 


-0.12633017E 
0.96735211E 
0.51021537E 
0.14368729E 

-0.12562806E 

~0.84628310E 

-0.28848102E 

-0.82990787E 


00 
00 
00 
00 
00 
00 
00 
00 


00 
01 
00 
00 
01 
01 
00 
00 


01 
00 
00 
01 
01 


-01 


01 
00 


0.16861611E 
0.25410408E 
0.21288166E 
0 .36542587E 
0 .94326350E 
0, 34003393E 
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1. Purpose 


The set of subroutines described in this paper computes the DFT and the IDFT of sequences with 
special properties. The special properties include: 


1. Symmetrical, real sequences 


2. Antisymmetrical, real sequences 

3. Real sequences with only odd harmonics 

4. Real, symmetrical sequences with only odd harmonics 

5. Real, antisymmetrical sequences with only odd harmonics. 
2. Method 


2.1 DFT Routines 


The subroutines for symmetrical and antisymmetrical sequences are based on the procedures 
described by Cooley, Lewis, and Welch [1]. If we call the input sequence x(n), defined for 
0 <n < N-1, where N is a power of 2 (for this implementation), then if x(m) is either symmetrical, 
Le., 


x(n) =x(N—n) nn =1,2,...,.N/2-1 (1) 
or antisymmetrical, i.e., 
x(n) = =x(N—n) n=1,2,....N/2-1 (2) 


then the N-Point DFT of x(n) (call it X¥(k), k =0,1,...,N—1), can be obtained from the N/2-point 
DFT of the sequence y(n) (call it Y(k), k =0,1,....N/2 — 1) where y(n) for symmetric sequences is 
obtained as 


y(n) = x(2n) + (x(QQnt—xQn-1)) 1 =1,2,...N/4—1 (3a) 
y(N/2=n) = x(2n) — (x(Qn4+1)—xQn-1)) n= 1,2,...,.N/4—-1 (3b) 
y(0) = x(0) (3c) 
y(N/4)= x(N/2) (3d) 
and for antisymmetric sequences, y(n) is obtained as 
y(n) = x(2n) + (xQn4+D—x(2n-1)) nn =1,2,..,.N/4—1 (4a) 
y(N/2—n) = —x(2n) + (x(2nt+D—x(2n-1)) nn =1,2,..,N/4-1 (4b) 
yO) = 2x(1) (4c) 
y(N/4) = -2x(N/2-1) (4d) 


The relation for obtaining X(k) from Y(k) for symmetric sequences is [1,2] 
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X(k) = Rel¥(k)] + MLO gna (5a) 
2 sin(= k) 
N 
X(N/2-k) = Re[¥(k)] - MUON ga ys (5b) 
2 sin(— k) 
N 
X(N-K) = X4(k) k= 12nesN/2—1 (5c) 
X(@) = B(O) + Rel ¥(O)] (5d) 
X(N/2) = —B(0) + Re[¥(0)] (Se) 
where 
wi 
4 
BO) =2 F x(2n+1) (6) 
n=O 


and * denotes complex conjugate. 


For antisymmetric sequences, the relation for obtaining ¥(k) from Y(k) is [1,2] 
Rel¥(k)] 


X(k) = Im[¥(4)] k= 1,2,.N/4 (7a) 
2sin(— k) 
N 
X(N/2-k) = -Imty(K)) — BEKO ga nya (7b) 
2 sin(— k) 
N 

x@ =0 (7c) 
X(N/2) = 0 (74) 


It should be noted that for either symmetric or antisymmetric sequences, only (N/2+1) (symmetric) or 
(N/2) (antisymmetric) points of x(n) need be specified. 


For sequences containing only odd harmonics, i.e., 
X(2k)=0 all k (8) 


where X(k) is the DFT of x(n), the N-point DFT of x(n) can be obtained from the N/2-point DFT 
of the sequence y(n) (call it ¥(k), k = 0,1,...,N/2 — 1), where y(n) is obtained as 


y(n) = 4 sin(2Z n)x(n) m= 0,1,..,N/2—1 (9) 
A recursion relation is used to obtain X¥(k) from Y(k). The required initial values are 
wat 
™1-> x(n)eos(2Z. n) (10a) 
n=0 
n even 
x 
a 2a 
=> x(n)eos(F- n) (10b) 
n=0 
n odd 
giving 
Re[X(1)] = 2(7,+7) (10c) 
Re[X(N/2-1)] = 2(7,-T>) (10d) 
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The initial condition 
Im[X (1)] = —RelY(0)]/2 (1) 


along with Eq (10c) gives the recursion 


Re[¥ (2k+1) = Im[¥(k)] + Re[X¥(2k-1)]  &k = 1,2,....N/4-—2 (12a) 
Im[X(2k+1)] = —Re[¥(k)] + Im[¥(2k-1)]_ k = 1,2,...,.N/4—2 (12b) 

with final values 
Im[X(N/2-1)] = Rel Y(N/4)1/2 (13) 


and Eq (10d) giving Re[¥(N/2—1)]. It should again be noted that only N/2 points of x(n) are 
required to implement the procedure described above. 


For real sequences that are both symmetrical, and possess only odd harmonics a combination of two 
of the above procedures can be used [2], to further reduce computation. For this case a total of N/4 
values of x(n) are required. The procedure is a cascade of the procedure for symmetric sequences with 
that for odd harmonic sequences. The procedure can be performed in either order (i.e., one can begin 
by accounting for symmetry and then odd harmonics, or vice versa). Details of the implementation are 
given in Ref. 5. 


For real sequences that are both antisymmetrical, and possess only odd harmonics another combina- 
tion of two of the above procedures can be used [5], to further reduce computation. For this case a 
total of (N/4+1) values of x(n) are required. The procedure is a cascade of the procedure for 
antisymmetric sequences with that for odd harmonic sequences. Again the procedure can be performed 
in either order (i.e. one can begin by accounting for antisymmetry, and then odd harmonics, or vice 
versa). Details of the implementation are given in Ref. 5. 


2.2 IDFT Routines 


The IDFT for sequences with the special properties discussed in Section 1 can be obtained from the 
DFT of these sequences by inverting the procedures described in Section 2.1. Throughout this section 
we denote the original sequence as x(n) and its DFT as X(k). 


For symmetrical sequences we first precompute the sample x(1), defined as 


N/Q-1 
x(1) = X1=X(0) — X(N/2)+2 > X(k)e08(2 k) (14) 
kel 
The complex sequence Y(k) is obtained from X(k) via the relation 
¥ (0) = (¥(0)4+X(N/2))/2 (15a) 
Rel[Y¥(k)] = [¥(k)+X (N/2-k)]/2 k=1, N/4 (15b) 


Im{¥ (&)] = 1X (k)—X(N/2-K)] Isin( 2% &)] emlanaNy4 (15e) 


The N/2-point IDFT of ¥(k) is taken giving the N/2-point real sequence y(n). The sequence x(m) is 
obtained from y(v) via the recursion relation 


x(2n) = [y(n)+y(N/2—n)I/2 n= 1,2,...,.N/4—1 (16a) 
x(2n+1) = [y(n)—y(N/2—n)1/2 + x(2n-1) sn = 1,2,...,N/4—1 (16b) 

with initial conditions 
x(0) = y (0) (17a) 
x(1) = X1 (17b) 

and final condition 
x(N/2) = y(N/4) (17c) 
For antisymmetrical sequences the complex sequence Y(k) is obtained from X(k) via the relation 

Im[Y (k)] = [¥(k)—X(N/2—k)]/2 k = 1,2,....N/4 (18a) 
ReL¥(K)] =~ LX(K)+X(N/2-)] bin(2% kk = QnA (186) 
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The N/2-point IDFT of ¥(k) is taken giving the N/2-point real sequence y(n). The sequence x(n) is 
obtained from y(m) via the recursion relation 


x (2n) = [y(n)—y(N/2-n))/2 n= 1,2,.. (19a) 
x(2nt1) = [y(n)+y(N/2—n)]/2 + x(2n—-D) n=1,2,....N/4—1 (19b) 
with initial conditions 
x(0)=0 (20a) 
x(1) = y(0)/2 (20b) 
and final condition 
x (N/2-1) = —y(N/4)/2 (20c) 
For odd harmonic sequences we first precompute the value of x (0) as 
x(0) = 2 “S$  Relx(2k+1)] oy) 
N & 
The complex sequence ¥(k) is obtained from X(k) via the relation 
Re[Y¥(k)] = — Im[X¥(2k+1)]+Im[¥(2k—1)]_ k = 1,2,...,N/4—1 (22a) 
Im[Y (k)] = Re[X¥(2k+1)]—Re[X(2k-1)]_—k = 1,2,....N/4—1 (22b) 
with initial and final values 
Re[¥(0) = —2Im[X(1)] (23a) 
Im[¥(0)] = 0 (23b) 
Re[¥(N/4)] = 2Im[X(N/2-1)] (23c) 
Im[Y(N/4)] =0 (23d) 


The N/2-point IDFT of Y(k) is taken giving the N/2-point real sequence y(). The sequence x(n) is 
obtained from y(m) via the relation 


x(n) = y(n)/I4 sin(22- mil n= OND (24) 


with x(0) given from Eq. (21). 


The IDFT for symmetric and antisymmetric, odd harmonic sequences is obtained by cascading the 
procedures given above. The specific implementations used here first account for the time symmetry 
(or antisymmetry) and then use the odd harmonics property of the sequence, as was done for the direct 
transforms. Details of the implementation are given in Ref. 5. 


3. Program Description 
3.1 Usage 


The package consists of 10 subroutines; the DFT routines FFTSYM, FFTASM, FFTOHM, 
FFTSOH, FFTAOH, and the IDFT routines IFTSYM, IFTASM, IFTOHM, IFTSOH and IFTAOH. All 
the subroutines use the real input FFT subroutines FAST and FSST [3,4]. For the direct transforms, 
the user passes the required number of values of the data sequence ((N/2+1) for FFISYM, N/2 for 
FFTASM, N/2 for FFTOHM, N/4 for FFTSOH, (N/4+1) for FFTAOH), the size of the full data 
sequence (N), and a scratch array of size (N/2+2) for all subroutines except FFTOHM which doesn’t 
require the scratch array. The subroutines return the DFT of x(n), X(k), in the same array in which 
the data is passed. The format in which X¥(k) is returned is as follows: 


FFTSYM - only the real part of X¥(k), k = 0,1,...,N/2 is returned. 

FFTASM - only the imaginary part of ¥(k), k = 0,1,...,N/2 is returned. 

FFTOHM - only the odd harmonics of ¥(k), k = 1,3,...,NV/2—1 are returned. The real part of X(k) is 
followed by the imaginary part of X (k). 

FFTSOH - only the real parts of the odd harmonics of ¥(k), k = 1,3,...,N/2—1 are returned. 
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FFTAOH - only the imaginary parts of the odd harmonics of ¥(k) k = 1,3,...,N/2 — 1 are returned. 


The FFT subroutine FAST is a real input, radix 4 and radix 2 FFT. Thus the subroutines only work 
for sequences whose length Nis a power of 2. (If a more general FFT is used, these routines will work 
for sequences whose length Nis a multiple of either 4 (for FFTSYM, FFTASM, and FFTOHM), or 8 
(for FFTSOH and FFTAOH)). 


For the inverse transforms, the user passes the required number of values of the transform (N/2+1 
for IFTSYM and IFTASM, N/2 for IFTOHM, N/4 for IFTSOH, and N/4 for IFTAOH), in the format 
returned by the direct transform routines, the size of the full data sequence (N), and a scratch array of 
size (N/2+2) for all subroutines except IFTOHM which does the transform in place. The inverse sub- 
routines return the IDFT of X(k), i.e. the original sequence, x(m), in the same array in which the data 
is passed, in the format required for the forward transforms. 


The inverse FFT subroutine FSST is a real input, radix 4 and radix 2 inverse FFT. Thus the sub- 
routines only work for sequences whose length N is a power of 2. (Again if a more general inverse 
FFT is used, these subroutines will work for values of N which are multiples of either 4 (for IFTSYM, 
IFTASM and IFTOHM), or 8 (for IFTSOH and IFTAOH). 


3.2 Description of Parameters of FFT Subroutines 
3.2.1 FFTSYM 


This subroutine is used to give the DFT for real, symmetric, N-point sequences where N can be any 
power of 2, or a multiple of 4 consistent with the FFT subroutines. The call to FFTSYM is 


CALL FFTSYM (X,N,Y) 
where 


X Array of size (N/2+1) points. On input X contains the first (N/2+1) values of x(n). On output 
X contains the (N/2+1) real parts of the transform of the input. 


N__ True size of input sequence. 
Y Scratch array of size (N/2+2). 
3.2.2 FFTASM 


This subroutine is used to give the DFT for real, antisymmetric, N-point sequences where N can be 
any power of 2, or a multiple of 4 consistent with the FFT subroutine. The call to FFTASM is 


CALL FFTASM (X,N,Y) 
where 


X Array of size (N/2+1) points. On input X contains the first (N/2) values of x(n). On output X 
contains the (N/2+1) imaginary parts of the transform of the input. 


N __ True size of input sequence. 
Y Scratch array of size (N/2+2). 
3.2.3 FFTOHM 


This subroutine is used to give the DFT for real, N-point sequences having only odd harmonics 
where N can be any power of 2 or a multiple of 4 consistent with the FFT subroutine. The call to 
FFTOHM is 


CALL FFTOHM (X,N) 
where 


X Array of size (N/2+2). On input X contains the first (N/2) values of x(n). On output X con- 
tains the (N/2) values (complex) of the odd harmonics of the transform of the input. The com- 
plex values are stored as the real part of each harmonic followed by the imaginary part. 


N __ True size of input sequence. 
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3.2.4 FFTSOH 


This subroutine is used to give the DFT for real, symmetric N-point sequences having only odd har- 
monics where N is any power of 2 or a multiple of 8 consistent with the FFT subroutine. The call to 
FFTSOH is 


CALL FFTSOH (X,N,Y) 
where 


X Array of size (N/4). On input X contains the first (N/4) values of x(n). On output X contains 
the (N/4) real parts of the odd harmonics of the transform of the input. 


N __ True size of input sequence. 
Y Scratch array of size (N/4+2). 
3.2.5 FFTAOH 


This subroutine is used to give the DFT for real, antisymmetric N-point sequences having only odd 
harmonics, where N is any power of 2 or a multiple of 8 consistent with the FFT subroutine. The call 
to FFTAOH is 


CALL FFTAOH (X,N,Y) 
where 


X Array of size (N/4+1). On input ¥ contains the first (N/4+1) values of x(), On output X con- 
tains the (N/4) imaginary parts of the odd harmonics of the transform of the input. 


N__ True size of input sequence. 
Y Scratch array of size (N/4+2). 
3.2.6 FAST 


The subroutine FAST is a radix 4 and radix 2 FFT subroutine [3,4] which uses real inputs. The call 
to FAST is 


CALL FAST (X,N) 
where 


X Array of size (N+2). On input X contains the N values of the sequence to be transformed; on 
output X contains the (N/2+1) complex values of the transform of the input. 


N __ Size of the input sequence. 
3.2.7 IFTSYM 


This subroutine is used to give the inverse DFT (IDFT) for real, symmetric N-point sequences 
where N can be any power of 2, or a multiple of 4 consistent with the IFFT subroutine. The call to 
IFTSYM is 


CALL IFTSYM (X,N,Y) 
where 


X Array of size (N/2+1) points. On input X contains the (N/2+1) real parts of the transform of 
x(n); on output X contains the first (V/2+1) values of x(n). 


N__ True size of input sequence. 
Y Scratch array of size (N/2+2). 
3.2.8 IFTASM 


This subroutine is used to give the IDFT for real, antisymmetric N-point sequences where N can be 
any power of 2, or a multiple of 4 consistent with the IFFT subroutine. The call to IFTASM is 


CALL IFTASM (X,N,Y) 
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where 


X Array of size (N/2+1) points. On input X contains the (N/2+1) imaginary parts of the transform 
of x(n); on output X contains the first (N/2) values of x(n). 


N __ True size of input sequence. 
Y Scratch array of size (N/2+2). 
3.2.9 IFTOHM 


This subroutine is used to give the IDFT for real, N-point sequences having only odd harmonics 
where N can be any power of 2, or a multiple of 4 consistent with the IFFT subroutine. The call to 
IFTOHM is 


CALL IFTOHM (X,N) 
where 


X Array of size (N/2+2). On input X contains the (N/2) values (complex) of the odd harmonics 
of the transform of x(n); on output X contains the first (N/2) values of x(n). On input, the 
complex values are stored as the real part of each harmonic followed by the imaginary part. 


N__ True size of input sequence. 
3.2.10 IFTSOH 


This subroutine is used to give the IDFT for real, symmetric N-point sequences having only odd 
harmonics where N is any power of 2 or a multiple of 8 consistent with the IFFT subroutine. The call 
to IFTSOH is 


CALL IFTSOH (X,N,Y) 
where 


X Array of size (N/4). On input X contains the (N/4) real parts of the odd harmonics of the 
transform of x (1); on output X contains the first (N/4) values of x(n). 


N __ True size of the input sequence. 
Y Scratch array of size (N/4+2). 
3.2.11 IFTAOH 


This subroutine is used to give the IDFT for real, antisymmetric N-point sequences having only odd 
harmonics, where Nis any power of 2 or a multiple of 8 consistent with the IFFT subroutine. The call 
to IFTAOH is 


CALL IFTAOH (X,N,Y) 
where 


X Array of size (N/4+1). On input X contains the (N/4) imaginary parts of the odd harmonics of 
the transform of x(n); on output X contains the first (N/4+1) values of x(n). 


N __ True size of input sequence. 
Y Scratch array of size (N/4+2). 
3.2.12 FSST 


The subroutine FSST is a radix 4 and radix 2 IFFT subroutine [3,4] for real input sequences. The 
call to FSST is 


CALL FSST (X,N) 
where 


X ~~ Array of size (N+2). On input X contains the (N/2+1) complex values of the transform of 
x(n); on output X contains the N real values of the sequence x(n). 
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N __ Size of the input sequence. 
3.3 Dimension Requirements 


The DIMENSION statement in the calling program should be modified according to the require- 
ments of each particular problem. The required dimensions of the arrays are 


X (N/2+2) values, or (N/4+1) values, depending on the subroutine used, where N is the size of 
the data array. 


Y —_(N/2+2) values, or (N/4+2) values depending on the subroutine used. 
3.4 Summary of User Requirements 


1. Specify the required number of values of x(n), the input sequence, or X(k) the 
transform of x(n). 


2. Call the appropriate FFT or IFFT subroutine. 
3. Output DFT or IDFT is obtained in the same array in which the input was defined. 


4. Test Program 


The test program FFTSUBT tests each of the 10 subroutines in order. The program first asks the 
user to specify the value of N (the sequence length). It then creates an N-point random, real, sym- 
metrical sequence, and then computes and prints out both the sequence and the entire (N/2+1) point 
complex FFT with the real part of each FFT component preceding the imaginary part. The first 
(N/2+1) time samples of x(n) are then passed on to the subroutine FFTSYM and the (N/2+1) points 
of the output (the real parts of the FFT) are printed. The output of FFTSYM is then passed to IFT- 
SYM and the resulting (N/2+1) values of x(m) are printed. 


The program next creates a new N-point random, real, antisymmetrical sequence and computes and 
prints out both the sequence and the entire (N/2+1) point complex FFT. The subroutine FFTASM is 
used on the first (N/2) time samples and the (N/2+1) points of the output (the imaginary parts of the 
FFT) are printed. The output of FFTASM is then passed to IFTASM and the resulting (N/2) values 
of x(n) are printed. 


The program next creates a new N-point random, real sequence with only odd harmonics. This 
sequence is created directly in the frequency domain by randomly specifying values for the complex 
odd harmonics, and setting the even harmonics to zero. Again the entire (N/2+1) complex values of 
the FFT of the sequence are printed. The real sequence is obtained as the inverse FFT of the DFT 
(obtained using FSST [3,4]) and the N time values are printed, and the first (N/2) time samples are 
passed on to the subroutine FFTOHM and the (N/4) complex odd harmonics are printed. The output 
of FFTOHM is then passed to IFTOHM and the resulting (N/2) values of x(n) are printed. 


Next, the program creates an N-point random, real, symmetric sequence with only odd harmonics. 
This sequence is again created directly in the frequency domain. The entire (N/2+1) complex values 
of the FFT of the sequence are printed. The time sequence is obtained using the inverse FFT subrou- 
tine FSST and the N values of x(n) are printed. The first (N/4) time samples are passed on to the 
subroutine FFTSOH and the (N/4) real values of the odd harmonics are printed. The output of 
FFTSOH is then passed to IFTSOH and the resulting (N/4) values of x(n) are printed. 


Finally the program creates an N-point random, real, antisymmetric sequence with only odd har- 
monics. This sequence is again created directly in the frequency domain. The entire (N/2+1) complex 
values of the FFT of the sequence are printed. The time sequence is again obtained using the inverse 
FFT subroutine FSST and the N values of x(n) are printed. The first (N/4+1) time samples are 
passed on to the subroutine FFTAOH and the (N/4) imaginary values of the odd harmonics are 
printed. The output of FFTAOH is then passed to IFTAOH and the resulting (N/4+1) values of x(n) 
are printed. 


The program then loops back and asks the user to specify a new value of N to repeat the tests. A 
value of N = 0 terminates the program. 
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The code for the test program and the subroutines FFTSYM, IFTSYM, FFTASM, IFTASM, 
FFTOHM, IFTOHM, FFTSOH, IFTSOH, FFTAOH, and IFTAOH is given in the Appendix. Table 1 
gives output of the test program for a value of N = 64. 
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Table 1 


TESTING N= 64 RANDOM SEQUENCES 


ORIGINAL SYMMETRIC SEQUENCE 
«38705E 00 -.27074E 00 
.37456E 00 +14464E 00 

-.42906E-01 -.26369E 00 
+16246E 00 -.24979E 00 
+43921E 00 +12403E 00 

~.30782E-01 -.44512E 00 
.10752E 00 »20151E 00 

-.38684E 00 -.10317E 00 

-.21793E 00 -43971E 00 
+12667E-01 -.23753E 00 

-.27397E 00 -.33395E 00 

-.10111E 00 -.14604E 00 
«91910E-02 -18318E 00 


64 POINT FFT OF SYMMETRIC 
-.97649E 00 .Q0000E 00 
»89407E-06 +38044E 01 
-.49675E 01 -.77672E-05 
-.31777E-05 -64130E 00 
-.50420E 00 + 20862E-05 
- .47684E-06 -84500E 00 
-.25434E 01 ~»29653E-05 
-.96858E-07 -.16805E 01 
-.10552E 01 -.10729E-05 
- -65565E-06 +19977E 01 
+32219E 01 -.13523E-05 
-.18887E-05 +22661E 01 
-18869E 01 -.11325E-05 
-00000E 00 


+26687E 00 
-34747E 00 
-.36682E 00 
+11770E 00 
-.77618E-01 
+19831E-01 
-.16857E 00 
«19831E-01 
-.77618E-01 
+11770E 00 
-.36682E 00 
-34747E 00 
.»26687E 00 


SEQUENCE 
«16830E 01 
- «33458E-06 
~31376E 00 
«00000E 00 
-.71593E 00 
+14163E-05 
+64029E-01 
-.14342E-05 
«52683E 00 
+99465E-06 
«36140E 01 
-.14305E-05 
+14484E 01 
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+18318E 00 
-14604E 00 
.33395E 00 
+23753E 00 
-43971E 00 
+10317E 00 
.20151E 00 
+44512E 00 
+12403E 00 
.24979E 00 
+26369E 00 
»14464E 00 
+27074E 00 


«12703E-05 
-56949E 00 
«53644E-06 
+10633E 01 
-15087E-05 
+35235E 00 
-00000E 00 
+31990E 01 
+23060E-05 
+25730E 01 
«32783E-05 
+26874E 00 
-67428E-06 


+ 91910E-02 
-.10111E 00 
-.27397E 00 

+12667E-01 
-.21793E 00 
~.38684E 00 

+10752E 00 
-.30782E-01 

+43921E 00 

+16246E 00 
~.42906E-01 

+37456E 00 


~20771E 01 
~ .83447E-06 
-.20166E 01 

+91270E-06 

+11459E 01 

+59232E-06 

-40404E 00 
- .82026E-06 

»38979E 00 

.00000E 00 

~67098E 00 

+18843E-05 
-.33604E 01 
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OUTPUT OF FFTSYM 


00 
01 
00 
01 
01 
01 
01 


-.97649E 
~.49675E 
50420E 
25434E 
-.10552E 

+32219E 

+ 18869E 


+16830E 01 
-31375E 00 
-.71593E 00 
+64028E-01 
.52684E 00 
+36141E 01 
-14484E 01 


OUTPUT OF IFTSYM 


+38705E 00 
«37456E 00 
--42906E-01 
+16247E 00 
+43921E 00 
-.30778E-01 
+10752E 00 


-.27074E 00 
+14464E 00 
~+26368E 00 
-+24979E 00 
+12403E 00 
-.44512E 00 
+20151E 00 
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+20771E 01 
--20166E 01 
-11459E 01 
-40406E 00 
-38979E 00 
-67099E 00 
-.33604E 01 


-26687E 00 
+34747E 00 
~.36682E 00 
+11770E 00 
«77618E-01 
+19838E-01 
--16857E 00 


ORIGINAL ANTISYMMETRIC SEQUENCE 


-00000E 00 
~+21999E-02 
-.28712E 00 
~+23091E-01 

~22906E 

~46185E 

+ 20444E 
--26180E 

+11538E 
-.18425E 

+13457E 
+38386E 

-13293E 


64 POINT FFT 
.-00000E 00 
-15215E 01 
+21458E-05 

-.24839E 01 
-25034E-05 
-29557E 00 
-48280E-05 
«32414E 01 

~.71153E-06 

-.15702E 01 

-.33379E-05 
-18796E 01 

- .89407E-06 
-O0000E 00 


~.27904E 


19906E-01 
15980E 00 
-+19834E-01 
+ 89684E-01 
--44326E 00 
-.28849E 00 
+36609E 00 
~.49225E 00 


OF ANTISYMMETRIC SEQUENCE 
+ 89407E-06 
+23367E 01 
-53644E-06 


-00000E 00 
+77486E-06 
-.10940E 01 
-00000E 00 
»32936E 01 
+17285E-05 
-66126E 01 
-83447E-06 
-17614E 01 
-.21458E-05 
82171E 00 
48056E-06 
-.22052E 01 


OUTPUT OF FFTASM 


-00000E 
--10940E 
-32936E 
-66127E 
«17614E 
~-82172E 
~.22052E 


00 
01 
01 
01 
01 
00 
01 


-.18801E 
-.73940E 
-.24539E 

-81999E 
--18068E 
-.30256E 
-.44018E 


01 
00 
01 
00 
01 
01 
00 


OUTPUT OF IFTASM 


-00000E 00 
- +22032E-02 
-.28712E 00 
-.23091E-01 

-22906E 00 

-46185E 00 

+20444E 00 


-.27904E 
--24590E 
+ 28336E 
+32732E 00 
+22204E 00 
--19906E-01 
--15980E 00 


00 
oo 
00 


-.33138E 00 
+29780E 00 
+48293E 00 

39747E 00 

15997E 00 

40348E 00 

-00000E 00 

+40348E 00 

+15997E 00 

»39747E 00 

48293E 00 

~.29780E 00 
+33138E 00 


-.44543E 00 
-00000E 00 
--17832E 01 
+19073E-05 
+26390E 00 
~.45896E-05 
-.14768E 01 
~.10133E-05 


+15215E 
~ -24839E 
+ 29558E 
+32414E 
-.15702E 
+18796E 
.00000E 


01 
01 
00 
01 
01 
01 
oo 


-.33138E 
-29780E 
+ 48293E 
-.39747E 
-.15997E 
- -40349E 


00 
00 
00 
oo 
oo 
00 
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-38044E 01 
+-64131E 00 


~84498E 00 - 


--16805E 01 
+19977E 01 
-22661E 01 


+18318E 00 
-.14604E 00 
-.33394E 00 
~.23753E 00 

+43971E 00 
~.10317E 00 


+49225E 00 
-+36609E 00 
+28849E 00 
-44326E 00 
~.89684E-01 
-19834E-01 
-15980E 00 
+19906E-01 
~-+22204E 00 
~+32732E 00 
-.28336E 00 
+24590E 00 
+27904E 00 


--18801E 01 
+35390E-06 
-+73939E 00 
+23842E-06 
-.24539E 01 
+59605E-06 
-81998E 00 
«14901E-05 
-.18068E 01 
-00000E 00 
-.30256E 01 
-53644E-06 
-.44018E 00 


+23367E 01 
00 
00 
01 
00 
01 


-.14768E 


«49225E 
~-36609E 
+28849E 00 
«44326E 00 
--89687E-01 
+19834E-01 


00 
00 


~.56949E 00 
-10633E 01 
-.35234E 00 
+31990E 01 
-.25730E 01 
+26874E 00 


~91908E-02 
--10110E 00 
--27397E 00 
+12673E-01 
21793E 00 
-.38684E 00 


-.13293E 00 
~.38386E 00 
-.13457E 00 
-18425E 00 
--11538E 00 
+26180E 00 
-.20444E 00 
--46185E 00 
~.22906E 00 
+23091E-01 
+28712E 00 
+21999E-02 


-.536445-06 
+31046E 00 
-00000E 00 
+36229E 01 
+ 83819E-06 
-50971E 00 

-.28014E-05 
-10330E 01 
+15497E-05 
+14661E 01 
«23842E-06 

~-45427E 01 
.00000E 00 


«31046E 00 
+36229E 01 
.50970E 00 
+10330E 01 
+14661E 01 
-.45427E 01 


--13293E 00 
-.-38386E 00 
-.13457E 00 
+18425E 00 
-.11538E 00 
+26180E 00 
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Table 1 
(Continued) 


64 POINT FFT OF ODD HARMONIC SEQUENCE 

-00000E 00 -00000E 00 -.39239E-01 -.24476E-01 -00000E 00 
-00000E 00 «24817E 00 «15425E 00 «00000E 00 -00000E 00 
-.78124E-01 -.58618E-01 ~Q0000E 00 -00000E 00 +27441E 00 
+12580E 00 +00000E 00 -00000E 00 +«24052E-01 -.40714E 00 
.00000E 00 «00000E 00 «48475E 00 «32958E 00 -00000E 00 
+00000E 00 -.30727E 00 -.20840E 00 -00000E 00 -00000E 00 
11457E 00 -.32150E-01 -00000E 00 .00000E 00 -.17971E 00 
«25726E 00 -00000E 00 -00000E 00 -30139E 00 -.47430E 00 
-QO0000E 00 ~00000E 00 +48588E 00 -40457E 00 +00000E 00 
+O0000E 00 -.39448E 00 -.26213E 00 -Q0000E 00 .QQ000E 00 
-.24664E 00 -.36574E 00 «00000E 00 -00000E 00 -47930E 00 
-12915E 00 -00000E 00 -Q0000E 00 -.54238E-01 +41343E 00 
-00000E 00 -00000E 00 -.22918E 00 -.91972E-01 -00000E 00 
-00000E 00 


ORIGINAL ODD HARMONIC SEQUENCE 

+ 20453E-01 +39408E-01 -.71683E-02 -.13413E-01 -.78217E-02 
29470E-01 +15314E-01 »57910E-02 -.27815E-01 +18272E-01 
20514E-01 +~10145E-01 -10090E-01 -,54190E-01 -.32431E-01 
+11459E-01 +11932E-01 «73036E-01 +28193E-01 -.19987E-01 
53000E-01 ~68412E-01 -.22913E-01 +21689E-02 +81134E-01 
87985E-01 -.46738E-02 +60175E-02 +33198E-01 -.23224E-01 
42196E-02 «91415E-02 -.20453E-01 -.39408E-01 «71683E-02 
+13413E-01 +78217E-02 +29470E-01 -.15314E-01 -.57910E-02 
+27815E-01 -.18272E-01 »20514E-01 -.10145E-01 10090E-01 
+54190E-01 +32431E-01 -.11459E-01 ~-.11932E-01 -.73036E-01 
28193E-01 +19987E-01 -53000E-01 -.68412E-01 «22913E-01 
21689E-02 -.81134E-01 »87985E-01 +46738E-02 -.60175E-02 
-.33198E-01 +23224E-01 +42196E-02 -.91415E-02 


OUTPUT OF FFTOHM 
-.39239E-01 -.24476E-01 +24817E 00 «15425E 00 -.78123E-01 
- .58619E-01 +27441E 00 «12580E 00 +24053E-01 40714E 00 
»48475E 00 +32958E 00 -.30727E 00 -.20840E 00 11458E 00 
~.32151E-01 -.17971E 00 +25726E 00 «30139E 00 47430E 00 
«48589E 00 -40457E 00 -.39448E 00 -.26213E 00 -.24664E 00 
36574E 00 .47931E 00 +12915E 00 -.54236E-01 +41343E 00 
-.22918E 00 -.91972E-01 


OUTPUT OF IFTOHM 
+20453E-01 .39408E-01 »71683E-02 -.13413E-01 -.78217E-02 
-.29470E-01 +15314E-01 .~57910E-02 -.27815E-01 +18272E-01 
-.20514E-01 +10145E-01 +10090E-01 -.54190E-01 -.32432E-01 
«11459E-01 «11932E-01 «73036E-01 +28193E-01 -.19987E-01 
-.53001E-01 + 68412E-01 +22913E-01 +21689E-02 +81134E-01 
-.87986E-01 -46738E-02 -60175E-02 «33198E-01 -.23224E-01 
-.42196E-02 «91415E-02 


' 


64 POINT FFT OF ODD HARMONIC, SYMMETRIC SEQUENCE 
-00000E 00 .-00000E 00 -.26539E 00 «O0000E 00 -00000E 00 
-00000E 00 +14412E 00 -O0000E 00 +00000E 00 -~00000E 00 
+22329E 00 -00000E 00 -O00000E 00 -O00000E 00 +26810E 00 
-00000E 00 »00000E 00 .00000E 00 -.30587E 00 -00000E 00 
-00000E 00 -00000E 00 +13275E 00 +00000E 00 -00000E 00 
-00000E 00 -.34142E 00 .00000E 00 .00000E 00 -00000E 00 
+94914E-01 -00000E 00 -O00000E 00 -Q0000E 00 -.34192E 00 
.00000E 00 -00000E 00 -00000E 00 -.14686E 00 -00000E 00 
-O00000E 00 -QO000E 00 -.44473E 00 -Q0000E 00 -O00000E 00 
-Q0000E 00 -.69936E-01 -00000E 00 -00000E 00 ~00000E 00 
+46172E-01 -Q0000E 00 ~O0000E 00 .00000E 00 -.78392E-03 
-00000E 00 -00000E 00 .Q00000E 00 -41555E 00 ~00000E 00 
-00000E 00 -OO000E 00 «12386E 00 -O0000E 00 -O0000E 00 
-00000E 00 
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Table 1 
(Continued) 


ORIGINAL ODD HARMONIC, SYMMETRIC SEQUENCE 


-.14629E-01 
96356E-02 
90984E-02 
40847E-01 
+85548E-02 
« 16822E-01 
- .43949E-01 
~30324E-01 
-95453E-02 
19091E-01 
24814E-01 
42268E-02 
-.75173E-02 


- .52831E-02 
-.32010E-01 
+17533E-01 
-00000E 00 
-.17533E-01 
+32010E-01 
-52831E-02 
-75174E-02 
-42268E-02 
+ 24814E-01 
«19091E-01 
-.95453E-02 
-.30324E-01 


OUTPUT OF FFTSOH 


-.26539E 00 
-13275E 00 
-.44473E 00 
.12386E 00 


«14412E 00 
-.34142E 00 
-.69939E-01 


OUTPUT OF IFTSOH 


-.14630E-01 
96353E-02 
90986E-02 
-.40847E-01 


~.52827E-02 
-.32011E-01 
+17533E-01 


+43949E-01 
-.16822E-01 
- -85548E-02 
.40847E-01 
+»90984E-02 
+» 96356E-02 
«14629E-01 
-96356E-02 
-90984E-02 
«40847E-01 
- .85548E-02 
-.16822E-01 
«43949E-01 


+22329E 00 
-94915E-01 
+ 46169E-01 


+ 43948E-01 
-.16822E-01 
~.85547E-02 


- .30324E-01 
- -95453E-02 
-19091E-01 
.~24814E-01 
+42268E-02 
+75173E-02 
-52831E-02 
+32010E-01 
-.17533E-01 
-Q0000E 00 
+17533E-01 
-.32010E-01 
-.52831E-02 


+26811E 00 
34192E 00 
-.78589E-03 


-.30324E-01 
- .95451E-02 
+19092E-01 


-.75174E-02 
42268E-02 
«24814E-01 
=.19091E-01 
~95453E-02 
«30324E-01 
+43949E-01 
-16822E-01 
-85548E-02 
40847E-01 
90984E-02 
-96356E-02 


«30587E 00 
14686E 00 
.41555E 00 


+ 75171E-02 
«42265E-02 
+24814E-01 


64 POINT FFT OF ODD HARMONIC, ANTISYMMETRIC SEQUENCE 


-00000E 00 
-00000E 00 
-00000E 00 
-.32781E 00 
.00000E 00 
.00000E 00 
.00000E 00 
»68952E-01 
-00000E 00 
-00000E 00 
-00000E 00 
-23911E 00 
-00000E 00 
.00000E 00 


-00000E 00 
.~00000E 00 
+80915E-01 
.00000E 00 
-00000E 00 
.00000E 00 
«27775E 00 
-00000E 00 
-00000E 00 
»00000E 00 
-.45259E 00 
-00000E 00 
-00000E 00 


-00000E 00 
-.45413E 00 
-00000E 00 
.00000E 00 
-00000E 00 
-.99167E-01 
-00000E 00 
-00000E 00 
-Q0000E 00 
+27765E 00 
-00000E 00 
.00000E 00 
-00000E 00 


+13362E 00 
-00000E 00 
-00000E 00 
-00000E 00 
+41614E 00 
.00000E 00 
-00000E 00 
-00000E 00 
-.37515E 00 
-00000E 00 
.00000E 00 
-00000E 00 
+28792E 00 


ORIGINAL ODD HARMONIC, ANTISYMMETRIC SEQUENCE 


»00000E 00 
-31662E-01 
+27449E-01 
- .65640E-01 
+68284E-02 
+22736E-02 
38045E-01 
40039E-01 
.39392E-02 
-61149E-02 
+» 20351E-01 
+38762E-01 
-.18682E-01 


- -30825E-03 
+20747E-02 
+23230E-01 
+24044E-01 
»23230E-01 
+»20747E-02 

-.30822E-03 

-+18682E-01 
+ 38762E-01 
+20351E-01 
-61149E-02 
+39392E-02 

- -40039E-01 


OUTPUT OF FFTAOH 


«13362E 00 
+41614E 00 
-.37515E 00 
+28792E 00 


-.45413E 00 
- -99163E-01 
-27765E 00 


-.38045E-01 
+22736E-02 


+ 68283E-02 


~ -65640E-01 
«27449E-01 
-31662E-01 
.»00000E 00 
-.31662E-01 
-.27449E-01 
-65640E-01 
~.68284E-02 
--22736E-02 
-38045E-01 


-»80916E-01 
+27776E 00 
-.45259E 00 
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«40039E-01 
- .39392E-02 
61149E-02 
20351E-01 
~.38762E-01 

«18682E-01 

+ 30825E-03 
-.20747E-02 
23230E-01 
24044E-01 
23230E-01 
-.20747E-02 

-30822E-03 


-.32781E 00 
-68951E-01 
-.23911E 00 


-00000E 00 
.00000E 00 
-00000E 00 
.46997E 00 
.00000E 00 
+ 00000E 00 
.00000E 00 
+ 72483E-01 
.00000E 00 
.00000E 00 
-00000E 00 
«43002E 00 
-00000E 00 


+ 18682E-01 
- .38762E-01 
-.20351E-01 
- -61149E-02 
-.39392E-02 

-40039E-01 

-38045E-01 
-.22736E-02 
- .68283E-02 

+65640E-01 
-.27449E-01 
-.31662E-01 


-46998E 00 
-.72483E-01 
-.43002E 00 


FFTSYM 


Section 1.3 
Table 1 
(Continued) 
OUTPUT OF IFTAOH 
.00000E 00 -.30849E-03 -.38045E-01 .40039E-01 .18682E-01 


39391E-02 -.38763E-01 
~61152E-02 -.20351E-01 


-31662E-01 +20747E-02 +22732E-02 
+27449E-01 ~23230E-01 -68284E-02 
-.65640E-01 +24044E-01 
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Mixed Radix Fast Fourier Transforms 


Richard C. Singleton 


SRI International 
Menlo Park, CA 94025 


1. Purpose 


Mixed radix fast Fourier transform algorithms are presented, for both real and complex input 
sequences. These algorithms also perform multi-variate Fourier transforms. In addition, the program 
used to test the Fourier transform subroutine includes a fast in-place sort subroutine (with tag array) 
and a short bi-variate normal random number subroutine. 


2. Method 
The subroutine FFT evaluates the equation 


2a 


nk 

X(k) =D x(ne *® 
n=O 
where x(n) and X(k) are complex, and k = 0,1,....N—1. This subroutine also computes the 1/N 
scaled inverse Fourier transform. The subroutine REALT, when called following FFT, completes the 
final transform step for a real sequence x(n) of length 2N. Earlier versions of these algorithms were 
published in 1969 [1], and the methods used were described then in detail. This paper has also been 
reprinted [2], without program listings. 


3. Usage 
3.1 Single-Variate Transform of Complex Input Data 
CALL FFT (A,B,1,N,1,—1) (transform, no scaling) 
or 
CALL FFT (A,B,1,N,1,1) (inverse, scaled by 1/N) 
where 


A Real array dimensioned to size N. On input, A contains the N real components of the data 
to be transformed. On output, the array A contains the Fourier cosine coefficients. The 
roles reverse for the inverse transform. 


B Real array dimensioned to size N. On input, B contains the N real components of the data 
to be transformed. On output, the array B contains the Fourier sine coefficients. The roles 
reverse for the inverse transform. 


N__ Size of input sequence, N. 
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3.2 Multi-variate Transform of Complex Input Data (Tri-variate Example) 


CALL FFT(A,B,N2*#N3,N1,1,—1) 
CALL FFT(A,B,N3,N2,N1,—1) 
CALL FFT(A,B,1,N3,N1*#N2,—1) 


where the input parameters are the same as in 3,1 above, except that arrays A and B are dimensioned 
(N1,N2,N3). The three calls to FFT can be arranged in any order. The inverse is computed by repeat- 
ing the above calls, but with the sign of the sixth parameter changed to plus. 


3.3 Single-variate Transform of 2*N Real Values, Stored Alternately A(1),B(1),...,A(N),B(N) 


CALL FFT(A,B,1,N,1,—1) 
CALL REALS(A,B,N,—1) 


or 


CALL FFT(A,B,1,N,1,—1) 
CALL REALT(A,B,1,N,1,—1) 


where the Fourier cosine coefficients are found in A(1),A(2),...,A(N),A(N+1) and the Fourier sine 
coefficients are found in B(1),B(2),...,B(N),B(N+1). The inverse is computed by changing the sign of 
the sixth parameter to plus, and reversing the order of the two calls; order is important. Scaling of the 
Fourier coefficients is the same as if FFT had been used to transform 2N real values in A, with B set to 
zero. As indicated above, either REALS or REALT can be used for a single-variate real transform; 
REALS is about ten percent faster than REALT. 


3.4 Bi-variate Transform of Real Input Data, N=N1*N2 


CALL FFT(A,B,N2,N1,1,—1) 

CALL REALT(A,B,N2,N1,1,—1) 

CALL FFT(A(N+1),B(N+1),1,N2,1,—1) 
CALL FFT(A,B,1,N2,N1,—1) 


where the real values are stored alternately in A and B. In this example, arrays A and B are dimen- 
sioned ((NI+1)*N2), and a 2*N1 by N2 transform is done. The call on FFT for the real dimension 
must be first, followed immediately by the corresponding call on REALT. (The folding frequency 
cosine coefficients are then in A(N+1),A(N+2),...,A(N+N2), and the corresponding locations in 
array B are set to zero.) The remaining calls may be in any order. If the sequence of calls is reversed 
and the sign of the sixth parameter is changed to plus, an inverse transform is done. 


3.5 Multi-variate Transform of Real Input Data (Tri-variate Example N=N1#N2*N3) 


CALL FFT(A,B,N3#N2,N1,1,—1) 
CALL REALT(A,B,N3*N2,N1,1,—1) 
CALL FFT(A(N+1),B(N+1),N3,N2,1,—1) 
CALL FFT(A(N+1),B(N+1),1,N3,N2,-1) 
CALL FFT(A,B,N3,N2,N1,—1) 

CALL FFT(A,B,1,N3,N2*N1,—1) 


where the real values are stored alternately in A and B. In this example, arrays A and B are dimen- 
sioned ((N1+1)*N2*N3). The order of the first two calls is fixed, but the remaining calls may be per- 
muted in any order. If the sequence of calls is reversed and the sign of the sixth parameter is changed 
to plus, an inverse transform is done. Adding one more dimension adds two more calls on FFT, one 
for the main array and another for the folding frequency values. There is no limit on the number of 
dimensions. 


The "real value" dimension need not be the column dimension, but the calls on FFT and REALT for 
the real value dimension must come first. 
3.6 Interleaved Storage of Real and Imaginary Data Values 


In any of the above examples, the array B can be replaced by A(2), and the magnitude of the sixth 
parameter set to 2. In this option, A(1),A(3),A(5)... hold the real values and A(2),A(4),A(6),... hold 
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the imaginary values. The values of the third, fourth, and fifth parameters are unchanged. This 
method of calling is particularly useful when transforming real data, in which case the first dimension is 
the real dimension...as in the examples in 3.4 and 3.5 above. 


3.7 Explanation of the Role of Parameters NSEG, N, NSPN and ISN 


FFT(A,B,NSEG,N,NSPN,ISN) 
REALT(A,B,NSEG,N,NSPN,ISN) 


ISN The sign of ISN determines the transform direction, negative for forward and positive for 
inverse. The magnitude of ISN determines the indexing increment for arrays A and B. 


N The dimension of the current variable. 


NSPN The spacing of consecutive data values while indexing the current variable, in units determined 
by the magnitude of ISN. 


NSEG NSEG*N«NSPN is the total number of complex data values. 


Users familiar with the original 1969 version should note the changed meaning of the third and fifth 
parameters; to convert a program calling the earlier version of FFT, the user should replace NSPAN by 
NSPAN/N and should replace NTOT by NTOT/NSPAN. This change was made to eliminate two pos- 
sible error conditions. 


3.8 Error Conditions 


The signs of N, NSPN, and NSEG are ignored, and any nonzero value can be valid. Any nonzero 
value of ISN can be valid, although it is not anticipated that magnitudes other than one or two will 
often be used. Thus the following error condition is recognized in FFT and REALT: 


NSEG*N*NSPN#ISN = 0 


This condition results in an error message and no transform. The corresponding error condition for 
REALS is N*ISN = 0. 


If N has more than 15 "factors", FFT terminates with an error message. The smallest number with 
16 "factors" is 12,754,584, so this error condition should not occur very often. (See [1] or [2].) 


4. Tests 


The subroutines included in this section have had extensive use in their earlier versions, and the 
modifications for inclusion in this publication have been held to a minimum. To enable the user to 
verify that the subroutines are working correctly on his system, a test program with sample output is 
included here. 


The tests used here first do a transform-inverse pair on N = 32 real values, using FFT, REALS and 
REALT. The input value, the Fourier coefficient values, then the inverse result are printed; the final 
inverse values are identical with the input values. The sorted error values for arrays A and B are also 
listed. 


The same sequence of N = 32 real values is then stored in array A, with array B set to zero, and a 
transform-inverse pair is done using FFT alone. The Fourier coefficients and final inverse values are 
printed; the Fourier coefficient values are seen to be the same as those obtained in the previous test. 
The first two tests are done using pseudo-random numbers on the unit interval. For the remaining 
tests, independent bi-variate random normal deviates with zero mean and unit standard deviation are 
used. The advantage of this approach is that the input data has an RMS value of one; the RMS error 
value for the final transform-inverse result then has a simple reference. 


The next set of tests runs through a variety of test examples, with only the RMS error values for 
the transform-inverse pair printed. These examples are designed to test all branches of the subroutine. 


The final test lists the Fourier coefficients for an 8 by 9 real transform, computed both by FFT alone 
(with zeros in the imaginary array) and by FFT and REALT. The results are identical, and illustrate 
the method used in REALT to store the folding frequency coefficients. 


1.4-3 


FFT Programs Chapter 1 


5. Acknowledgments 


The helpful comments of many users over the years have been useful in developing the revisions 
included in the current versions of FFT, REALS and REALT. I particularly appreciate Jim Cooley’s 
suggestions, including that of adding multi-variate indexing to REALT. Marie Dolan has been of great 
help in guiding me through the steps of preparing this material for publication. 


References 


1, R. C. Singleton, "An Algorithm for Computing the Mixed Radix Fast Fourier Transform", JEEE 
Trans. Audio and Electroacoust., Vol. AU-17, No. 2, pp. 93-100, June 1969. 


2. A. V. Oppenheim (ed.), Papers on Digital Signal Processing, The M.LT. Press, Cambridge, Mass., 
pp. 163-170, 1969. 


Table 1 


TEST OF FFT, REALS AND REALT FOR REAL VALUES 


REAL INPUT SEQUENCE --- 


J A(J) B(J) A(J+1) B(J+1) 
1 +22925607E+00 - 76687502E+00 +68317685E+00 «50919111E+00 
3 +87455959E+00 +64464100E+00 +84746840E+00 «35396343E+00 
5 +39889159E+00 +45709421E+00 +23630936E+00 + 13318189E+00 
i + 16605222E+00 «22602680E+00 +66245903E+00 +25021174E+00 
9 .61769668E+00 + 26246527E+00 +51266762E+00 +93920734E+00 
47 «62402816E+00 +42238195E+00 «93970599E+00 «28206823E+00 
13 +»46921754E+00 -54879178E-01 .51983086E+00 + 39682690E+00 
15 +11315656E+00 +60751725E+00 + 70150672E+00 -88705479E+00 
FOURIER COSINE AND SINE COEFFICIENTS --- 
J A(J) B(J) A(J+1) B(J+1) 
fF +15789569E+02 0. +13026034E+01 +19871480E+00 
3 +11936771E+01 -.28999118E+01 «40612714E-01 «72163937E+00 
5 -.46179909E+00 + 13081519E+01 +70122852E-01 -.15931004E-01 
7 27579355E+00 «10351044E+01 -46209660E+00 +11709983E-01 
9 -.16102664E+01 +30982473E+00 -.14930917E+01 -.87044475E+00 
11 +21015246E+00 -.18331043E+00 93344462E+00 -.55190813E-01 
13 +33632980E+00 -.10901590E+01 -.12900518E+01 + 18219048E+01 
15° -.12126616E+01 +75918926E+00 -.12663723E+01 -.10652233E+00 
17 +14023971E+01 0. 
TRANSFORM-INVERSE RESULT --- 
a A(J) B(J) A(J+1) B(J+1) 
1 +22925607E+00 + 76687502E+00 -68317685E+00 -50919111E+00 
3 «87455959E+00 -64464100E+00 -84746840E+00 + 35396343E+00 
5 +39889159E+00 «45709421E+00 +23630936E+00 «13318189E+00 
| + 16605222E+00 + 22602680E+00 +66245903E+00 +25021174E+00 
9 .61769668E+00 «26246527E+00 -51266762E+00 +93920734E+00 
1 +62402816E+00 +42238195E+00 +93970599E+00 «28206823E+00 
13 «46921754E+00 +54879178E-01 +51983086E+00 +39682690E+00 
15 + 11315656E+00 +»60751725E+00 «70150672E+00 -88705479E+00 
SORTED ERROR VALUES --- 
J A(a) g B(J) 
16 ~.36379788E-11 4 --36379788E-11 
6 ~.36379788E-11 6 -.36379788E-11 
11 ~.18189894E-11 12 ~ .36379788E-11 
12 Qo. 7 --18189894E-11 
10 0. 1 0. 
14 oO. 13 Oo. 
9 Oo. 14 oO. 
8 0. 11 0. 
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o. 
o. 
0. 


NeROWO2nS 


+22737368E-12 
-18189894E-11 
-18189894E-11 
-36379788E-11 
~36379788E-11 


+18189894E-11 
.18189894E-11 
«36379788E-11 
+54569682E-11 


TEST OF FFT FOR REAL VALUES 


FOURIER COSINE AND SINE COEFFICIENTS --- 


wyuw=4 


1 

13 
15 
17 
19 
21 
23 
25 
27 
29 
31 


A(J) 
+ 15789569E+02 
+11936771E+01 
-.46179909E+00 
-.27579355E+00 
-.16102664E+01 
+21015246E+00 
+ 33632980E+00 
-.12126616E+01 
+14023971E+01 
~.12126616E+01 
«33632980E+00 
+21015246E+00 
--16102664E+01 
-.27579355E+00 
-.46179909E+00 
+11936771E+01 


B(J) 

Oo. 
-.28999118E+01 
+13081519E+01 
.10351044E+01 
« 30982473E+00 
-.18331043E+00 
-.10901590E+01 
+ 75918926E+00 


0 
-.75918926E+00 
+ 10901590E+01 
«18331043E+00 
~.30982473E+00 
~.10351044E+01 
-.13081519E+01 
+28999118E+01 


TRANSFORM-INVERSE RESULT --- 


A(J) 
«22925607E+00 
-68317685E+00 
.87455959E+00 
-84746840E+00 
+ 39889159E+00 
«23630936E+00 
+ 16605222E+00 
-66245903E+00 
.61769668E+00 
~51266762E+00 
«62402816E+00 
-93970599E+00 
+46921754E+00 
.51983086E+00 
«11315656E+00 
+ 70150672E+00 


B(3) 


0. 
+40946464E-12 
- .41774510E-13 
-.42896152E-12 
+22737368E-12 
-40946464E-12 
- .86772019E-12 
98682366E-12 


0 
-.45282706E-13 

.22319622E-11 
-.59949178E-12 
- .22737368E-12 

«17737067E-11 
-.13224675E-11 
-.53207631E-12 


A(J+1) 
+13026034E+01 
+40612714E-01 
+70122852E-01 
«46209660E+00 

~.14930917E+01 
-.93344462E+00 
12900518E+01 
12663723E+01 
12663723E+01 
12900518E+01 
93344462E+00 
+14930917E+01 
«46209660E+00 
+70122852E-01 
+40612714E-01 
«13026034E+01 


A(J+1) 
-76687502E+00 
-50919111E+00 
+64464100E+00 
+35396343E+00 
+45709421E+00 
-13318189E+00 
+22602680E+00 
+ 25021174E+00 
+ 26246527E+00 
+ 93920734E+00 
+42238195E+00 
+ 28206823E+00 
-54879178E-01 
+39682690E+00 
+60751725E+00 
«88705479E+00 


SINGLE-VARIATE TESTS OF SUBROUTINES 


FFT 
REALS 
REALT 


PFT 
REALS 
REALT 


PFT 
REALS 
REALT 


FFT 


RMS ERROR 

N A ARRAY B ARRAY 

2 +137E-10 o. 

2 «386E-11 »103E-10 

2 + 386E-11 oO. 

3 »525E-11 +~297E-11 

3 ~951E-11 «872E-11 

3 ~951E-11 »235E-11 

5 +111E-10 +718E-11 

5 .986E-11 +~676E-11 

5 -986E-11 «182E-11 
210 +202E-10 +195E-10 
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B(J+1) 
-19871480E+00 
+ 72163937E+00 

-.15931004E-01 
.11709983E-01 
-.87044475E+00 
-.55190813E-01 
«18219048E+01 
~.10652233E+00 
+ 10652233E+00 
~.18219048E+01 
.55190813E-01 
+87044475E+00 
-.11709983E-01 
+ 15931004E-01 
-.72163937E+00 
-.19871480E+00 


B(J+1) 
~-45474735E-12 
-.15063506E-11 

+31852174E-12 
-.25880602E-11 
+22737368E-12 
- .82422957E-12 
+15004677E-11 
-.83580448E-13 
-.90949470E-12 
.25863756E-11 
-.13622561E-12 
+10499186E-11 
«22737368E-12 
-85265128E-13 
-.77326909E-12 
+ 12806616E-11 
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Table 1 
(Continued) 
REALS 210 -913E-11 -810E-11 
REALT 210 ~913E-11 «»804E-11 
FFT 1000 .233E-10 +232E-10 
REALS 1000 -836E-11 -815E-11 
REALT 1000 -836E-11 -814E-11 
FFT 2000 +233E-10 +224E-10 
REALS 2000 .~823E-11 »B847E-11 
REALT 2000 -823E-11 -846E-11 
FFT 1024 -193E-10 -191E-10 
REALS 1024 ~850E-11 + 781E-11 
REALT 1024 «850E-11 «779E-11 
FFT 2048 .195E-10 +191E-10 
REALS 2048 .818E-11 -797E-11 
REALT 2048 -818E-11 + 796E-11 
FFT 4096 -199E-10 -202E-10 
REALS 4096 -842E-11 -833E-11 
REALT 4096 ~842E-11 ~832E-11 
FFT 2187 -272E-10 -259E-10 
REALS 2187 -846E-11 ~805E-11 
REALT 2187 ~846E-11 ~B04E-11 
FFT 3125 -281E-10 +283E-10 
REALS 3125 -853E-11 ~821E-11 
REALT 3125 -853E-11 -820E-11 
FFT 2401 +285E-10 «284E-10 
REALS 2401 -849E-11 -833E-11 
REALT 2401 -849E-11 -832E-11 
FFT 1331 -401E-10 .391E-10 
REALS 1331 -879E-11 ~825E-11 
REALT 1331 +879E-11 «824E-11 
FFT 2197 «293E-10 .288E-10 
REALS 2197 -834E-11 -833E-11 
REALT 2197 + 834E-11 -833E-11 
FFT 289 «233E-10 »226E-10 
REALS 289 »875E-11 . 769E-11 
REALT 289 -875E-11 -764E-11 
FFT 361 +220E-10 +221E-10 
REALS 361 «886E-11 ~847E-11 
REALT 361 -886E-11 -843E-11 
FFT 529 -425E-10 -402E-10 
REALS 529 -917E-11 -862E-11 
REALT 529 -917E-11 -860E-11 


MULTI-VARIATE TESTS OF SUBROUTINES 


RMS ERROR 
N A ARRAY B ARRAY 
FFT 1080 +162E-10 ~153E-10 
FFT 1080 «119E-10 0. 
REALT 1080 «921E-11 912E-11 


REALT 1080 ~917E-11 oO. 


8 BY 9 REAL TRANSFORM - FFT VS. FFT AND REALT 


J A(J) B(J) c(g) DiI) 
1 -.18509182E+02 0. -.18509182E+02 0. 
2 -,63947267E+01 .97863880E+01 -.63947267E+01 -97863880E+01 
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3 -.78263712E+01 
4 28572332E+01 
5 10921541E+02 
6 -.28572332E+01 
7 
8 


~.78263712E+01 
~.63947267E+01 

9 «46916612E+01 
10 -.70044347E+01 
1 «~25491851E+01 
12 -57953108E+00 
13° -.16600946E+01 
14 -.56098061E+01 
15 -73299048E+01 
16 . 18873938E+01 
17° ~.89631614E+01 
18 «30901046E+01 
19 .21382018E+01 
20 -67686785E+01 
21 -.50517953E+01 
22 -.16673708E+01 
23 +16322342E+02 
24 «38034461E+01 
25 4 -.52371225E+01 
26 -.56868554E+01 
27°) -.25913244E+01 
25446027E+01 
29 -.89007166E+01 
30 «34296333E+01 
31 -.13925042E+01 
32 -.35248262E+01 
33 +72919622E+00 
34 +42411487E+01 
35 .38718108E+01 
36 +32136390E+01 
37 .54606791E+00 
38 ~61526515E+01 
39 -.56624794E+01 
40 .15985812E+01 
4) +72919622E+00 
42 -15985812E+01 
43 -.56624794E+01 
44 +61526515E+01 
45 «»54606791E+00 
46 +32136390E+01 
47 .38718108E+01 
48 ~42411487E+01 
49 -.52371225E+01 
35248262E+01 
51 -.13925042E+01 
52 «34296333E+01 
53 -.89007166E+01 
25446027E+01 
25913244E+01 
56868554E+01 
57 -.89631614E+01 
58 + 38034461E+01 
59 «16322342E+02 
60 -.16673708E+01 
61 -.50517953E+01 
62 .67686785E+01 
63 + 21382018E+01 
64 -30901046E+01 
65 ~46916612E+01 
66 +18873938E+01 
67 «73299048E+01 
68 -.56098061E+01 
69 -.16600946E+01 
70 .57953108E+00 
71 +25491851E+01 
72° -.70044347E+01 


Table 1 
(Continued) 

+25613030E+01 -.78263712E+01 
10412241E+00 -.28572332E+01 
0. -46916612E+01 
=.10412241E+00 -.70044347E+01 
-.25613030E+01 .25491851E+01 
-.97863880E+01 .57953108E+00 
+51173453E+01 -.89631614E+01 
+40156402E+01 .30901046E+01 
+37405183E+01 .21382018E+01 
-.32320996E+01  .67686785E+01 
~.23477400E+01 -.52371225E+01 
-.48183139E+01 56868554E+01 
-85799253E+01 25913244E+01 
+22840714E+01 -.25446027E+01 
~.30857869E+01 .72919622E+00 
:92397343E+01 © .42411487E+01 
-.49035087E+01 .38718108E+01 
-76038599E+01  .32136390E+01 
-67468637E+01 .72919622E+00 
-.28199019E+01 ©. 15985812E+01 
-.10742899E+02 -.56624794E+01 
:13483020E+02 © .61526515E+01 
-98372729E+01 -.52371225E+01 
+61338098E+01 -.35248262E+01 
-12416175E+02 -.13925042E+01 
-.11353010E+01 .34296333E+01 
+30849262E+01 -.89631614E+01 
-.39694987E+01 .38034461E+01 
-.41322696E+01 .16322342E+02 
+23698139E+01 -.16673708E+01 
~.24843916E+01  .46916612E+01 
-11135565E+02 —. 18873938E+01 
+31550578E+01  .73299048E+01 
-.21105050E+01 56098061E+01 
~.22407029E+01 -.10921541E+02 
+11118265E+02 16600946E+01 
114726845E+02 -.50517953E+01 
-.91010428E+01 -.89007166E+01 
+24843916E+01  .54606791E+00 
-91010428E+01  .54606791E+00 
-.14726845E+02 -.89007166E+01 
-.11118265E+02 -.50517953E+01 
+22407029E+01 -.16600946E+01 
+21105050E+01 

-.31550578E+01 

-.11135565E+02 

-.98372729E+01 
-.23698139E+01 

-41322696E+01 

+39694987E+01 

~.30849262E+01 

-11353010E+01 

-.12416175E+02 

-.61338098E+01 

-30857869E+01 

-.13483020E+02 

-10742899E+02 

+28199019E+01 

- .67468637E+01 

-.76038599E+01 

-49035087E+01 

-.92397343E+01 

~.51173453E+01 

-.22840714E+01 
-.85799253E+01 

-48183139E+01 

+ 23477400E+01 

-32320996E+01 
-.37405183E+01 
-.40156402E+01 
251 
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«10412241E+00 
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22840714E+01 
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Optimized Mass Storage FFT Program 


Donald Fraser 


CSIRO, Division of Computing Research 
Canberra City, ACT 2601, Australia 


1. Purpose 


The program computes the discrete Fourier transform (DFT) and inverse discrete Fourier transform 
(IDFT), in one or more dimensions, of a (large) array in mass store. 


2. Method 


The program is an implementation of the optimal sorting algorithm of the author [1] which allows a 
base 2 version of the Cooley-Tukey FFT algorithm [2,3,4] efficient access to a mass store array. 
Optimal sorting for the mass storage FFT has been determined independently by DeLotto and Dotti 
[5,6], but in the author’s version the emphasis is on ‘in-place’ array modification. This results in 
slightly higher mass store I/O than the minimum, but requires no additional mass store working space. 
The method is also discussed in [7] and is a logical extension of the work of Singleton [8] and Brenner 
(9). 


The program computes in-place the discrete Fourier transform of a one-dimensional or a multidi- 
mensional array. In the one-dimensional case the transform is defined by 


No1 + 22 ak 
X(k) =SCAL ¥ x(n)e  % » ik =0;1,...,N—1 a) 
n=O 


where SCAL is an arbitrary scaling factor, and / = /—1, the sign of the exponent being either minus 
(DFT) or plus (IDFT). 


The definition Eq. (1) is easily generalized to cover more than one dimension; for example the 
two-dimensional case is given by 


N,-1 Nol + j2n| ee 22h 

X(k,,k,) =SCAL ES YE x(mne iy Me (2) 
m=0 n=0 
for k; =0,1,...,.M—1 and ky =0,1,...,Np-1 


The elements x(m) or x(m,,m2) in Eq. (1) or Eq. (2) are the initial complex data in a mass store 
array, These are replaced by the elements ¥(k) or X(k;,k2) as the final complex data. 


Complex data is transformed by an in-place, base-2 algorithm using post-computation bit-reversal to 
sort the array [3]. The computation is handled by a modified, in-core FFT routine which does a 
sequence of partial transforms of the mass store array (the method is discussed in more detail in section 
5). The sorting algorithm [1] calculates the most efficient way to access the mass store array for these 
computations, Finally the sorting algorithm is used to carry out an overall bit-reversed permutation of 
the array, again with as few accesses as possible (I/O efficiency is discussed in section 4). 


Computation and sorting occur ‘in-place’, through a combination of ‘virtual’ permutations, where 
mass store blocks are accessed according to an indexing algorithm but are left physically unpermuted, 
and symmetric permutations, which interchange blocks according to a generalized index bit-reversal. In 
[1] it is shown that any unsymmetric permutation can be formed from two suitable symmetric 
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permutations, each of which can be done in-place. 


Multidimensional transforms are achieved automatically by making use of the indexing structure of 
the FFT algorithm itself. No change to the order of access of elements is necessary, so that the full 
advantage of the sorting algorithm and program simplicity is maintained. 


For transforms in which the initial or final data is real, the usual time saving algorithm [4] is avail- 
able to unscramble a half length complex transform of packed real data (or vice-versa). This requires 
an extra accessing and computing pass through the mass store array, but still results in a saving of 
nearly half the computation and I/O time. In this method, it is easy to allow a choice in the degree of 
redundancy in the final, complex result. The array may be expanded to full redundancy (twice the phy- 
sical length of the original packed real array), or to partial redundancy, or maintained the same physical 
length by elimination of all redundancy. 

Finally, we must define a number of terms used in the discussion. ‘Core store’ is used to describe a 
region where the elements of an array are equally accessible at random. ‘Mass store’ implies a region 
where elements are grouped into ‘blocks’ or ‘records’ which must be accessed as units, but which units 
are accessible efficiently at random. A ‘pass’ is an array operation which leaves the array elements in- 
place ready for another array operation. Thus, an ‘I/O pass’ reads and writes back once all the blocks 
of an array (this is a logical definition — sometimes in practice not all blocks need be physically 
accessed, or some may be accessed more than once). 


3. Program Description 
3.1 Usage 
Figure 1 shows the structure of the internal subroutine calling network. 


MASS STORE 170 


Fig. 1 Internal subroutine calling network. (Solid and dashed lines distinguish roughly 
between ‘main path’ and ‘reference’ calls). 


The program consists of a set of subroutines written in ANSI FORTRAN, only two of which are called 
by a user program. If the data are always complex the user program calls subroutine CMFFT. If the 
input data or the results are real, the user program may call the faster subroutine RMFFT. Either sub- 
routine replaces a one-dimensional or a multidimensional array in mass store by its discrete Fourier 
transform, as defined in section 2. 


(If the elements of the mass store array are considered to be singly indexed by i=0,1,2,..., then the 
indices of the definitions map into i=n in the one-dimensional case or i=n,+n-N, in the two- 
dimensional case, resultant transposition giving i=k,+k,-N>. In general, i=n\+n)-N,+n3‘N2:N,+... 
Remember also that for FORTRAN, indices are increased by 1.) 
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The mass store file is assumed to exist and to have been previously defined to the FORTRAN sys- 
tem and opened for random access by the user. The file is accessed through two system-dependent 
subroutines MFREAD and MFWRIT (see section 7). All other subroutines are system-independent. 

The user has freedom to specify total array size, mass store block or record size, core store working 
space size and the dimensioning of the array, except that all sizes are to base 2 and are given by their 
binary exponents. 


3.2 Calling Method 
The complex FFT routine is called by 
CALL CMFFT (MEXA,NDIM,ISGN,IDIR,SCAL,BUFA,IBEX,ICEX) 
while the faster, real-to-complex (or vice-versa) FFT routine is called by 
CALL RMFFT (MEXA,NDIM,ISGN,IDIR,SCAL,BUFA,IBEX,ICEX,IPAK) 


3.3 Description of Parameters 


MEXA Integer array of size NDIM (see below). MEXA consists of a list of dimension size binary 
exponents, defining the dimensioning of the mass store array. For example, a one- 
dimensional array has a size of 2**MEXA(1) elements. A two-dimensional array has 
2"*MEXA(2) sets of 2**MEXA(1) adjacent elements each (N of definition Eq. (1) or Ny 
and N, of definition Eq. (2) are 2®* MEXA(1) and 2#*MEXA(2) in initial order). 


Notes: 


a) The FFT routines actively modify the MEXA list, if necessary, leaving it in the order 
corresponding to the final array dimensioning. In general, its order is reversed by the 
FFT, except in the special case with routine CMFFT discussed under parameter IDIR 
below. The MEXA list should therefore be linked to a unique mass store array so that it 
always indicates the current dimensioning of that array. 


b 


The MEXA list of exponents always refers to the dimensioning of a full array, as required 
by routine CMFFT or by routine RMFFT with IPAK=+1 (see below). The complex 
result of routine RMFFT operating on real data is truncated when IPAK=0 or —1, so that 
the MEXA list elements in these cases may refer to a virtual array length. 


c) The first element of the list always gives the size 2x* MEXA(1) of the set or sets of adja- 
cent elements in the first dimension of the mass store array. If data are of type complex, 
this is the number of complex elements in each set while if data are of type real (e.g. 
before calling routine RMFFT in direction real-to-complex), this is the number of real 
elements. 


d) Mass store array dimensioning is independent of I/O block transfer size and core working 
space size. 


NDIM Number of dimensions in mass store array (size of MEXA list). 


Range 1 < NDIM < 4 (RMFFT), to increase, see section 5. 
or 1 < NDIM < M (CMFFT). 


(M) Not a call parameter, but defined here for convenience. M = Sum to NDIM of MEXA list, 
giving total mass store array size = 2** M elements (number of complex elements for routine 
CMFFT, real or complex elements for routine RMFFT, but see under IPAK packing parame- 
ter below). 


ISGN The sign of ISGN is the sign of the complex exponent of the transform definition (e.g. equa- 
tion 1 or 2). A positive or negative sign results in the inverse transform of the other, but see 
also below. 


IDIR Transform direction (RMFFT), reversal (CMFFT) parameter. Routine RMFFT converts 
packed real data to complex data (or vice-versa) during transformation, so that IDIR is 
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SCAL 


BUFA 


IBEX 


ICEX 


IPAK 


needed to determine the direction, independently of ISGN, thus: 
IDIR=—1 _Real-to-complex (RMFFT), Dimension reversal 
IDIR=+1 Complex-to-real (RMFFT), Dimension reversal. 


(Note that it is usually most convenient to use the same variable for both ISGN and IDIR so 
that a single negation results in transform inversion). 


Routine CMFFT does not need a direction parameter, other than ISGN, and IDIR is used in 
this case to set dimension reversal (transposition in two dimensions) or not, as required, 
thus: 

IDIR not zero, Dimension reversal (more efficient I/O) 

IDIR=0 DO NOT USE (RMFFT), Suppress reversal (CMFFT). 
Arbitrary type real scale factor of Eqs. (1) or (2). If SCAL=1.0 computation is fastest as no 
scaling occurs. 
Array in core to be used as workspace by FFT routines. Note that internal FFT subroutines 
assume the following: 
a) BUFA is either type real or complex, to suit local needs. 


b) BUFA is given the trivial dimension BUFA(1) internally, since its actual size is known 
only as the exponent ICEX (see below). 


c) Type complex data is assumed to be stored in the sequence 
real/imaginary/real/imaginary/.. in core store and mass store. 


Some of these points may upset some FORTRAN compilers. 


Mass store I/O block transfer size binary exponent. Block or record size = 2** IBEX real ele- 
ments. 


IBEX < ICEX—2 (RMFFT), 
IBEX < ICEX—1 (CMFFT). 


Core store working space size binary exponent. Dimension of BUFA = 2**ICEX real ele- 
ments. 


Limits are IBEX+2 < ICEX < M (RMFFT), 
or IBEX+1 < ICEX < M+l (CMFFT). 


Packing parameter (routine RMFFT) only. 
Determines the degree of redundancy (discussed in more detail in section 5) desired in the 
complex result after a real-to-complex transform, thus: 


Limits are 2 
or 1 


IPAK=+1 gives a fully redundant complex result. The final mass store array is exactly 
twice the physical length of the initial real array, having the same number, 
2«*M, of complex elements as initial real elements. This is the same result that 
is obtained when calling CMFFT with the initial data occupying the real part of a 
complex array, zero imaginary. 


IPAK=0 gives a partly redundant complex result, slightly longer than the initial real 
array. In this case there are 2**(M—1) + 2®*(M—MEXA(NDIM)) complex 
elements in the final array, the MEXA list in the order after the transform 
(increased to an integral number of mass store blocks, if necessary). This is 
probably the most useful packing. 


IPAK=-1 _ gives a result containing no redundancy, and having exactly the same physical 
length as the initial 2«* M real elements, or 2®* (M—1) complex elements. This 
is achieved by squeezing together those parts of the array having internal redun- 
dancy. The exact algorithm is discussed in section 5. No information is lost 
and, for one or two dimensions, only a little sorting is needed to access 
unsqueezed information. For example, in one dimension, the real value at the 
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Nyquist frequency becomes the imaginary part of the zero frequency element, 
which also must be real. 


Notes: 


a) For IPAK=+1 or 0 the mass store array file must be extendable. IPAK=—1 has the advan- 
tage that the mass store array file remains a fixed length, but has the disadvantage that some 
user effort is needed to access complex data correctly. 


b) In the complex-to-real direction, IPAK=+1 or 0 are equivalent, since only part of a fully 
redundant complex array is accessed by RMFFT in this direction. But IPAK=—1 must be 
used in both directions to correctly handle the squeezed complex array. 


3.4 Helper Routine 


To help the user set up the arguments of section 3.3 and to determine the mass store file and block 
sizes, a helper routine MFPAR is included. Use of the routine is not essential, but is recommended. 
The routine is called by: 


IERR = MFPAR (IRMF,ICOMP) 


with IRMF=—1 if mass store data is currently packed real or +1 if data is currently complex when using 
routine RMFFT. When using routine CMFFT, IRMF=0. If ICOMP=0 the argument exponents 
MEXA( ), IBEX and ICEX are defined by the user while if ICOMP is not zero the exponents are to be 
computed by MFPAR. 


Three COMMON blocks are used to transmit other data, thus: 


COMMON/MFARG/ MEXA(4),NDIM,ISGN,IDIR,SCAL,IBEX,ICEX ,IPAK 
COMMON/MFVAL/ DIMA(4),TDM1,RDM1,FBLK,TBLK,RBLK,RCOR,SIZE 
COMMON/MFINT/ NDMA(4),NTD1,NRD1,NFBK,NTBK,NRBK,NRCR,NSZE 


MFARG holds a four element MEXA() list (for up to four dimensions) followed by the other 
mass store FFT call arguments (except BUFA). NDIM, IBEX, ICEX and IPAK must be present 
(unless ICOMP not zero), while ISGN, IDIR and SCAL are ignored here. 


COMMON blocks MFVAL and MFINT return data computed by routine MFPAR. These include 
the four element arrays DIMA() and NDMA() corresponding element by element to MEXA() but 
containing the actual dimension sizes 2** MEXA(). Similarly RBLK, NRBK and RCOR, NRCR hold 
the sizes 2®*IBEX and 2**ICEX. Note that MFINT variables are one to one integer conversions of 
MFVAL variables, which are type real. A local variable FIXMAX, the biggest positive integer in the 
machine, determines whether a conversion is allowed. Any values not converted are set to —1 in 
MFINT and the function returns MFPAR=~1 to indicate this. IBEX and ICEX are forced to be within 
the limits defined in section 3.3, and MFPAR=+1 if IBEX is forced too small. Otherwise the function 
returns MFPAR=0 normally. 


If the helper subroutine argument ICOMP is not zero, the computation is reversed and MEXA( ) 
exponents are computed from given DIMA() real sizes, IBEX and ICEX computed from RBLK and 
RCOR real sizes. Sizes are adjusted to be integral powers of 2, adjusted up or down to the closest 
power on a log scale. NDIM and IPAK must still be given in MFARG. 


The most useful values computed by MFPAR are NTD1, NRD1, NFBK, NTBK and NRBK (in 
MFINT). NRBK is 2**IBEX and is the number of reals in the ‘record’ used for mass store access by 
the FFT. NTBK is the current total number of records of size NRBK, or the current file length. 
NFBK, on the other hand, is the maximum number of records of size NRBK to be expected, including 
any mass store array expansion by routine RMFFT (see IPAK=0 or 1 in section 3.3). NFBK is thus 
useful for defining the maximum file length to the operating system. 


NRDI1 is the number of reals in an equivalent ‘record’ of the current first dimension length (‘first’ 
defined by current MEXA(1)). NTD1 is the current number of such equivalent records and these two 
values are useful for logically accessing a multidimensional mass store array by the user (though not so 
useful if NDIM=1). Note that to do this the I/O routines MFREAD and MFWRIT must be able to 
handle correctly ‘records’ different in length from NRBK, otherwise NTBK and NRBK should be used. 
This will be system dependent (see section 7). 
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NSZE, SIZE is the effective total size of of the mass store array (2**M) and is useful, for example, 
in computing the scale factor SCAL. 


Note that MFPAR should be called just prior to user file access, and with the correct value for 
IRMF, to ensure the computed variables reflect the current state of the mass store array. 


3.5 Example 


Suppose we wish to transform a two-dimensional real array having 512 rows (2e*9) of 256 adjacent 
real elements each (2**8), or a total of 128K real elements (2**17), where K = 1024. Suppose we 
decide to allow a core store working space of 8K real elements (2** 13) and to access the mass store 
array in blocks of 128 real elements (2e*7) each, these being quite independent of array dimensioning. 
Then, using the helper routine MFPAR (section 3.4) to compute file parameters, the mass store file is 
defined and opened for random access, loadd with data and subroutine RMFFT is called with: 


COMMON/MFARG/ MEXA(4),NDIM,ISGN,IDIR,SCAL,IBEX,ICEX,IPAK 
COMMON/MFVAL/ DIMA(4),TDM1,RDM1,FBLK,TBLK,RBLK,RCOR,SIZE 
COMMON/MFINT/ NDMA(4),NTD1,NRD1,NFBK,NTBK,NRBK,NRCR,NSZE 
C COMMON BLOCKS USED BY HELPER ROUTN MFPAR (NOT ESSENTIAL) 
¢ 
REAL BUFA(8192) 
COMPLEX CBUFA (4096) 
EQUIVALENCE (BUFA(1),CBUFA(1)) 
C WORKING ARRAY IN CORE (EQUIVALENCED FOR USER ACCESS) 
Cc 
MEXA(1)=8 
MEXA(2)=9 
NDIM=2 
ISGN=-1 
IDIR=—1 
SCAL=1.0 
IBEX=7 
ICEX=13 
IPAK=1 
C MASS STORE FFT ARGUMENTS INITIALIZED 
Cc 
IRMF=—1 
ICOMP=0 
IERR=MFPAR (IRMF,ICOMP) 
C HELPER ROUTINE, DATA REAL, RMFFT, EXPONENTS DEFINED, IF(IERR.EQ.O) OK 
C COMPUTES FILE PARAMETERS IN COMMON AREAS (NOT ESSENTIAL, BUT USEFUL) 
Cc 
(open mass store file here) 
C HERE CAN OPEN MASS STORE FILE, NFBK MAX ‘RECDS’ OF NRBK REALS 
c 
DO 2 JB=1,NTD1 (or NTBK) 
DO 1 I=1,NRD1 (or NRBK) 
BUFA(I)= (Enter a real variable here) 


CALL MFWRIT (BUFA,NRD1,JB) (or (BUFA,NRBK,JB)) 
LOAD MASS STORE FILE WITH PACKED REAL DATA (NTD1=512, NRD1=256) 
(IF MFREAD/MFWRIT REQUIRE FIXED RECD LENGTH, USE NTBK,NRBK INSTEAD) 


aaqvra= 


CALL RMFFT (MEXA,NDIM,ISGN,IDIR,SCAL,BUFA,IBEX,ICEX,IPAK) 
resulting in the DFT of Eq. (2), with SCAL=1.0, Nj=256 and N,=512 and a negative complex 


exponent. Because the initial data are packed real and because the parameter IPAK=1 is chosen, the 
mass store array will be extended to 128K complex elements, or twice its initial physical size. This 
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array is a fully redundant transform of the original, having 256 rows (2**8) of 512 adjacent complex 
elements (2#*9), the dimensions being reversed or transposed. To indicate transposition the MEXA 
list will be reversed (MEXA(1)=9, MEXA(2)=8 after the transform). 


To save unnecessary array extension the last parameter IPAK can be made 0 or —1. If IPAK=0 the 
result is a partially redundant transform, being the first 129 rows (2**MEXA(2)/2+1) of the 
transform, of 512 adjacent complex elements each. The first and last rows each have an internal conju- 
gate symmetry, but other redundancy is deleted. 


If IPAK=—1 the first and last rows above are ‘squeezed’ together, the second half of the last row 
becoming the second half of the first row. In addition, the first and middle rea! elements of the last 
row become the imaginary parts of the first and middle elements of the first row, resulting in an array 
of 128 rows of 512 complex elements, exactly the same physical length as the initial array, so that no 
file extension is necessary (see section 5). 


The complex result is accessed, then an inverse transform is called by: 


IRMF=+1 

IERR=MFPAR (IRMF,ICOMP) 
C HELPER ROUTINE AGAIN, DATA COMPLEX, ROUTINE RMFFT, IF(IERR.EQ.O) OK 
Cc 


NCNT=NRD1/2 (or NRBK/2) 

C NCNT IS THE NUMBER OF COMPLEX ELEMENTS IN RECORD 
DO 4 JB=1,NTD1 (or NTBK) 
CALL MFREAD (BUFA,NRD1,JB) — (or (BUFA,NRBK,JB)) 
DO 3 I=1,NCNT 


3 (access each complex element CBUF(I) here) 
Cc 
4 CALL MFWRIT (BUFA,NRD1,JB) (or BUFA,NRBK,JB)) 
C COMPLEX RESULT READ BY USER (WRITING NEW VALUES IF DESIRED) 
C (IF MFREAD/MFWRIT REQUIRE FIXED RECD LENGTH, USE NTBK.NRBK INSTEAD) 
(y 
ISGN=-ISGN 
IDIR=—IDIR 
SCAL= 1.0/SIZE 
CALL RMFFT (MEXA,NDIM,ISGN,IDIR,SCAL,BUFA, IBEX ,ICEX,IPAK) 


the scale factor SCAL, using SIZE=2**M computed by MFPAR, is chosen here to normalize the 
result to the same scale as the original data. The result is a real array having 512 rows of 256 adjacent 
real elements each, the MEXA list being restored to its initial order. 


3.6 Addendum — Transposing, Dimension Shifting 


The sorting algorithm used in the mass storage FFT may also be used for changing the order of 
dimensioning of a multidimensional mass store array. (This is similar to, but more general than, 
Eklundh’s method [10]). As an example, and in addition to the FFT routines, a dimension shifting 
routine DMPERM is included for completeness, called thus: 


CALL DMPERM (MEXA,NDIM,NSHFT,IREX,BUFA,IBEX,ICEX) 
where the arguments MEXA, NDIM, BUPA, IBEX, ICEX have the same meaning as in the FFT calls. 
The other parameters are: 
NSHFT Dimension shift count. 


NSHFT=0 No shift or change occurs. 
NSHFT=1,2 etc. _ First-to-next dimension, circular NSHFT place shift, Modulo (NDIM). 
NSHFT=-1 Dimension order reversed. 


IREX ‘Element size’ binary exponent (size =2** IREX reals), thus IREX=0 for real array, 
IREX=1 for complex array. 


1.5-7 


FFT Programs Chapter 1 


Most of the comments concerning the FFT routine parameters apply also to this routine. The mass 
store array is either real or complex (or ‘elements’ of multiple reals), with an MEXA list defining the 
current dimensioning (binary exponents). The MEXA list is actively modified by the routine if neces- 
sary. (Note that to sort arrays of elements smaller in size than type real, such as the type byte elements 
of some systems, it is necessary to alter type statements for BUFA and TEMP variables in all subrou- 
tines called). 


The routine is quite trivial in design, consisting of only twenty statements. It operates by calling the 
generalized mass store bit-reversed sorting routine MFSORT, used internally by the FFT routines, and 
therefore has a similar I/O efficiency to the FFT routines (section 4). 


4. Input/Output Efficiency 


The number of I/O passes (see definitions, section 2) through the mass store array depends on the 
array size (2"*M), the core store working space size (2**ICEX) and the I/O block or record size 
(2**IBEX). In general, the larger the working space and the smaller the block size the better, but 
block size should not be made too small because of other overheads. The FFT computation requires 
1((M—IBEX+1)/(ICEX—IBEX)) passes involving I/O (where J(x) is the smallest integer greater than 
or equal to x). Post computation sorting requires a similar number of passes (without sorting overlap), 
although DeLotto and Dotti [5] mention ((M-ICEX+1)/(ICEX—IBEX)) passes. The reason this is 
not achieved is that in-place sorting requires M—IBEX+1 virtual permutations to leave a physically 
unpermuted array. A change in the algorithm to a smaller number M—ICEX+1 virtual permutations 
Tequires an extra block-sorting pass of mass store, nullifying the advantage. 


Figure 2 gives the maximum range of block size exponent IBEX necessary to keep the number of 
I/O passes, N, of the mass store array low, given ICEX and M. Solid lines bound the optimum N=4, 
Dashed lines are the boundaries for the next best N=6 passes, and it should not be difficult to operate 
with N=4 or 6 in most cases. When calling the half-length transform by subroutine RMFFT, increase 
diagram M and N by one to obtain the working M and N. 


The hatched line cutting across the figure gives a bound below which all mass store passes access all 
blocks. In the area above the line, /((IBEX—1)/(ICEX—IBEX)) sorting passes are required with an 
additional pass of mass store involving a block reshuffle, in which only some of the blocks are accessed. 
That is, the optimum can approach N=3 passes. Given an I/O system which allows alteration of the 
index key of a block, the block shuffle can be replaced by an index shuffle, giving N—1 passes in the 
upper area. Note also that the diagram is only approximate, as integral rounding effects may increase or 
decrease the number of passes by one at some points. 


Run time depends on two main factors, the computation time of the in-core FFT and the I/O time. 
A total elapsed time can be written approximately 


T = TC+M*2**M + TM Nx 26M 


where TC and TM are unit computation and unit mass store average access and transfer times 
corresponding to each complex element. As an example, consider two very different computer sys- 
tems, a PDP 11/40 system and a CYBER 76 installation. Then we may expect TC=0.5 ms (PDP 11) or 
2 us (CYBER), and TM=1 ms (PDP 11, IBEX=7) or 0.5 ms (CYBER, IBEX=9) for routine CMFFT. 
Calling subroutine RMFFT with packed real data roughly halves the time, so that a 256x256 real array 
can be transformed in about 5 minutes (PDP 11) or 1 second (CYBER) CPU time and 8 minutes (PDP 
11) or 1 minute (CYBER) elapsed time. But in machines such as the CYBER, where computing speed 
is very great compared to I/O latency, the routines are used to great advantage for transforming arrays 
in LCM (extended memory) in place of mass store, using high speed block-copy operations between 
this and main memory (see sections 6 and 7). Whether an array is multidimensional or not makes little 
difference to efficiency. 


Both TC and TM are block size dependent, there being fixed overheads per block. Both therefore 
can be written 


TC = TCO + TCA/2** (IBEX—1) and TM = TMO + TMA/2«« (IBEX—1) 


1.5-8 


Section 1.5 MSFFT 


Fig. 2 Mass store I/O passes N related to binary exponents IBEX, ICEX and M, for rou- 
tine CMFFT. Increase diagram values of M and N by one to obtain working M and N for 
routine RMFFT. 


where TCA is the FFT computation overhead per block and TMA is the average mass store access time 
per block. TCO and TMO are the limits for large block size. TCA and TMA set a useful lower limit 
for block size. In the examples above TM is mainly the result of TMA, or system block access time. 
Increasing block size reduces TM but with a probable increase in N (depending on M and ICEX). TC 
is mainly due to TCO, TCA becoming important typically when IBEX < 5. To determine the most 
efficient parameter combination, begin by choosing ICEX as large as possible, use Fig. 2 as a guide in 
choosing IBEX but follow this up by timing comparisons over a range of IBEX. 


The program was written to test the sorting algorithm [1] in practice. At the same time a useful and 
efficient Fourier program has been obtained, operating with a very general set of parameters. Some 
parameter combinations can lead to short cuts, not detected or implemented here (see section 5). 
Efficiency in a particular case can no doubt be improved by some recoding, at the expense of a loss in 
generality or increase in code complexity. 


Hopefully, this program will stimulate designers not only of fast transforms but also of general pur- 
pose systems. Sorting by index bit manipulation should be considered an important concept for new 
machine architecture. Index bit-reversal is simple to achieve in hardware and, in its generalized form 
(1], is a symmetric permutation (allowing in-place operation) which forms the basis of a number of 
useful permutations, not exclusively associated with the FFT. 
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5. Discussion of Algorithm 
5.1 General 


The structure of the mass storage FFT program is shown in Fig. 1. When using real data, routine 
RMFFT calls CMFFT with a half length complex array before unscrambling by MFRCMP. If neces- 
sary, routines CMFFT and below may be overlaid with routines MFRCMP and MFRLOD. CMFFT 
controls the sequence of mass store accessing for in-core computation and sorting of the complex FFT. 
Routines MFCOMP and MFRCMP carry out the FFT computation and unscrambling of data in core 
store. MFREV, controlled by routine MFSORT, carries out a bit-reversed permutation on elements in 
core store or on whole blocks in mass store. MFLOAD and MFRLOD load and unload core store for 
the in-core routines, calling on MFREAD and MFWRIT (section 7). MFINDX defines a virtual per- 
mutation of the mass store array during the complex FFT operation. MFSUM sums elements in the 
dimensioning list MEXA( ), sorting them if necessary. Routine MFPAR is discussed in section 3.4 and 
routine DMPERM in section 3.6. 


The main problem in writing a mass store FFT program is to devise an efficient means of accessing 
widely spaced data elements for use in the FFT computation kernel, and for sorting from bit-reversed 
order [3]. Singleton [8] describes an algorithm for accessing a mass store array two blocks at a time to 
carry out each computing pass of an FFT. He organizes mass store accesses in such a way that each 
I/O and computing pass results in a one place cyclic shift of array element index bits. This allows the 
FFT kernel program to access the same elements in core store on each pass, which not only simplifies 
the program but also brings ‘widely separated’ elements in the original array ‘within reach’ of the in- 
core computation. Bit-reversed sorting is done in a similar manner. For an array of 2**M elements, 
the basic method requires (2M—1) I/O passes. 


With efficient, random access mass store it is possible to use an indexing algorithm to read widely 
scattered blocks, equivalent to a virtual permutation of the array. After an in-core operation the blocks 
are written back in-place, the blocks remaining physically unpermuted by the operation. In [1] an algo- 
rithm is described which uses this method to compute the FFT. The indexing subroutine MFINDX 
computes the required sequence of block indices using an algorithm which is a generalization of the 
Block Indexing Algorithm of [1], p. 303. This is equivalent to a cyclic shift (a number of places) of a 
set of the block index bits. 


5.2 Complex Data 


Unlike Singleton’s algorithm, an attempt is made to load as many blocks together as possible in core 
store. In this way it is possible to include a number of FFT computing passes while the blocks are in 
core store, reducing the number of I/O passes by a factor ICEX—IBEX (see section 4). Routine 
CMFFT uses a slightly modified version of the algorithm of [1], p. 307 for this purpose, doing M—C 
instead of M—B initial computing passes with virtual permutations, followed by final C pass computa- 
tions with direct access, instead of final B pass computations. 1/O efficiency is unchanged, but the algo- 
rithm is neater (sizes being 2**B elements per block, 2**C in core store, 2** M total, all complex). 


Routine MFCOMP computes the FFT in core store. But, unlike other FFT routines, the number of 
computing passes NPAS, and the effective initial pass number IPAS, are not fixed but are passed by the 
calling routine CMFFT. Weighting factors are computed using SIN, COS functions on mass store block 
boundaries but recursively within block boundaries, while array element accessing is ordered to minim- 
ize these computations. Multidimensional transforms are achieved by restarting the weighting factor 
sequence over passes corresponding to the exponent of each dimension, requiring no change to the 
order of access of elements. 


Finally, routine MFSORT is called to sort the array from bit-reversed order. The algorithm is a 
slightly modified version of the sorting algorithm of [1], pp. 305-307, to allow the reversal of a more 
general set of index bits. Its structure is very similar to CMFFT, having a first stage using the virtual 
cyclic shift permutation for block access, with pairs of in-core bit-reversed permutations (MFREV) 
instead of FFT computations. (The pairs allow unsymmetric cyclic bit shift permutations to be done 
in-place, in-core). Only one in-core permutation is required on the first I/O pass. These are followed 
by a final bit-reversed permutation of whole blocks, if necessary. 
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In the special case when IDIR=0, MFSORT is called a number of times to individually reverse bits 
corresponding to each dimension exponent. This allows the complex FFT to be done without dimen- 
sion reversal (but note that dimension reversal is required by RMFFT). The dimension shifting sub- 
routine DMPERM, of section 3.6, also uses this feature. In both these cases, I/O is not fully optimized 
and specially written programs could reduce the number of I/O passes by combining some of the 
separate, in-core permutations. 


Bit-reversed index pairs are generated by a very efficient recursion algorithm (routine MFREV). 
The algorithm maintains a hierarchy of ‘reversed’ integers of increasing number of bits, up to 2 less 
than the number being reversed. Incrementing a reversed integer then requires the alternate simple 
addition of a constant or replacement by the next lower incremented reversed integer in the hierarchy, 
recursively. For example, with a 3 bit reversal, the reversed set is (0,4,2,6,1,5,3,7) where the next 
value is obtained either by adding 4 to the last or by replacing it by one of the values (0,2,1,3) of a 2 
bit reversed set. 


This method of reversed series generation is in itself fast, as recursion depths are small on average. 
But, in addition, only quarter length series are generated (—2 bits) and the full length series is derived 
by scaling by 2 and adding offsets. This is equivalent to reversing an integer a(integer—2 bits)b to 
b(reversed integer—2 bits)a where a and b are the outer bits. There are four possible combinations for 
ab, but only those reversals greater numerically than before reversal are required (to prevent nullifying 
double swaps), leaving in general the three offsets 1...0, 0...0 and 1...1. In particular, only the first 
offset is required if the internal (reversed integer—2 bits) is smaller than or the same as before reversal. 
Thus, only valid swap index pairs are generated, saving the unnecessary reversed integer generation of 
some other methods. 


5.3 Real Data 


For transforms in which the initial or final data is real, a half length complex transform of packed 
real data must be unscrambled (or vice-versa) by routine MFRCMP. The method relies on complex- 
conjugate symmetry in the transform of real data [4]. Calculation of indices of multidimensional sym- 
metry is more difficult than in the one-dimensional case. To do this a recursion algorithm is used, 
which is most easily described by the following FORTRAN program (for two dimensions, N1 by N2 
elements): 


L2=N2/2 + 1 
DO 1 J2=1,L2 
K2=N2+2-J2 
IF(J2.EQ.1)K2=1 
L1=NI1 
IF(J2.EQ.K2)L1=N1/2 + 1 
DO 1 Jl=1,L1 
K1=N1+2-J1 
IF(J1.EQ.1)K1=1 
C (Now have A(K1,K2) and A(J1,J2) as a pair with conjugate symmetry) 
1 CONTINUE 


Note is taken of the special cases which exist when the J index is 1 (FORTRAN) and when the J and K 
indices are equal. The general case follows by repetition of the code between the two DO statements, 
replacing J2 by Jj etc. In routine MFRCMP arrays JAYA(4) etc. are used for this purpose. To increase 
the number of dimensions allowed in RMFFT (section 3.3), increase the array sizes. To help visualize 
“the result, the index relationships (FORTRAN index —1) for an 8 by 4 array are as follows (r for real 
IF (index (K1,K2).EQ.index(J1,J2)), where index(J1,J2) = J1+(J2—1)*N1 for example, c for complex 
conjugate): 


roo = 01S 02s 4S c3_- 2s OL 
10 11 12 aSig (44 15 Cae 
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The array above represents the transformation and transposition of a 4 by 8 real array (imaginary 
part zero). However, we may also consider it to represent the scrambled transform of an array of ini- 
tially packed real data, occupying alternately real and imaginary elements, that is initially 8 by 8 real 
values. In this case the result is only half length, element pairs such as 15 and cl5 above containing 
information which can be unscrambled to give a new element 15 and an element 33 in place of cl5. In 
addition, new elements cl5 and c33 are derived. Thus the array is expanded to an 8 by 8 full transform 
of the real data: 


100 «Ol Ss (02-03 04 «= c03 2c 
: aml 3 baa itt) tails dlls St (rl | loemaale 
20 21 22 23 24 25 26 27 
50 31°" Sr Srs” S45 36) oT 

40 «410 «42043 44 c43 ch2— cd 

030 «637° «636 «e385 3433-32 1 

c20 c27 26 c25 c24 23 22 c2l 

clO cl7 cl6 clS cl4 cl3 cl2 cll 


Note that the same indexing algorithm applies in both examples (with different N2) but during 
unscrambling and expansion only the half-length symmetry is used (N2=4), corresponding expanded 
rows in the new array are obtained by a direct offset (4 in this case). Thus, by half-length symmetry, 
initial rows 1 and 3 are accessed together for unscrambling; these are replaced by unscrambled rows 1 
and 3 of the full array while new rows 5 and 7 are also computed and added to the array. It is this abil- 
ity to add data beyond the existing data which makes dimension reversal essential for in-place computa- 
tion in the real mass store FFT routine RMFFT. 


The complete array is ‘fully redundant’, nearly half the elements being complex conjugates of the 
other half. If the last three rows of the example are left out the result is ‘partially redundant’, since 
row 0 and row 4 still have some internal redundancy. To eliminate all redundancy, rows 0 and 4 can be 
merged (c43,c42,c41 replacing c03,c02,c01), and pairs of real elements combined as single complex ele- 
ments (r40 as the imaginary part with r00 real, r44 with 04). 


The exact algorithm by which an array, with IPAK=0 or —1, can be restored to full redundancy is 
given by the half-length symmetry program above, putting: 


A(J1,J2+N2) = CONJG( A(K1,K2)) 
and A(K1,K2+N2) = CONJG( A(J1,J2)),  IF(J2.NE.1), 


with special provision IF(J2.EQ.1) when IPAK=—1, below 


A(K1,K2+N2) = A(K1,K2) 
A(J1,J2+N2) = CONJG( A(K1,K2)) 
and A(K1,K2) = CONJG( A(J1,J2)) 


and IF(index(K1,K2).EQ.index(J1,J2)) when IPAK=—1, values are real, below 


A(J1,J2+N2)= CMPLX( AIMAG( A(J1,J2)), 0.) 
and A(J1,J2) = CMPLX( REAL( A(J1,J2)), 0.) 


the general case follows with Jj and Nj instead of J2 and N2 and as before with repetition of the code 
between DO loops. 


6. Test Programs 


A universal test program is provided which sets up, for a given M, exhaustive permutations and 
combinations of the different parameters IBEX, ICEX and NDIM from | to 3 dimensions. Mass store 
is simulated, through dummy routines MFREAD and MFWRIT, by a core store array so that the pro- 
gram is independent of system I/O. 


The program stores a pseudo random number sequence in the simulated mass store, transforms this 
by the mass store FFT routines and compares the result with a discrete Fourier transform computed 
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naively by routine NAIVE. An inverse mass store FFT is called and the result compared with the ini- 
tial data) Maximum differences are noted and various levels of data and difference print-out are avail- 
able through parameter IPRINT. The test is considered successful if maximum differences are explain- 
able in terms of machine round-off errors (see Table 1). 


Because the tests are exhaustive and because of the naive DFT computation the program is quite 
slow when the overall array size exponent M is other than very small. For example, in a CYBER 76 
computer with M=5 the program takes 0.3 seconds while with M=10 the program takes about 800 
seconds. Less exhaustive testing can be done by replacing program DO-loop variables by fixed vari- 
ables (see program comments). 


Example test programs are also included for accessing mass store in two specific computer systems. 
These are a CYBER 76 (true mass store and LCM ‘static’ store) and a PDP 11. Mass store I/O rou- 
tines for other systems should be easily devised based on these examples and the comments of section 
ie 


7. System-Dependent I/O Routines 
The system-dependent random access transfers between mass store and core store are handled by 


two subroutines called internally by the FFT routines, thus: 


CALL MFREAD (BUFA,NB,JB) Read block into core store 
and CALL MFWRIT (BUFA,NB,JB) Write block from core store 


where BUFA is the core store address for the start of the transfer, NB is the number of real elements 
to be transferred and JB is the desired block or record number. The range of JB is: 


for CMFFT or RMFFT if IPAK=+1 
1 < JB < 2**(M-IBEX+1), 


for RMFFT if IPAK=0 


1 < JB < 2**(M-—IBEX) + 2*#*(M—MEXA(NDIM)-IBEX +1), for 
MEXA(NDIM)+IBEX < M+1, 


or 1 <JB < 2**(M-IBEX) +1 for MEXA(NDIM)+IBEX > M+l, 
(the MEXA list in the order after the transform) 


for RMFFT if IPAK=—1 
1 < JB < 2**(M—IBEX). 


In addition, the I/O subroutines must know what file to access and any starting block offset, which 
may be given through COMMON variables, for example. The routines expect the mass store file to be 
defined and opened. The user program may, of course, call MFREAD and MFWRIT itself to load 
mass store with data or read the transform result. 


For example, in PDP 11 FORTRAN a random access occurs with 


SUBROUTINE MFREAD (BUFA,NB,JB) 

C READ BLOCK, INDEX JB, FROM MASS STORE TO BUFA, NB REAL VALUES 
REAL BUFA(NB) 
COMMON/FFTCOM/LUN 
READ (LUN’JB)(BUFA(I),I=1,NB) or READ (LUN’JB) BUFA 
RETURN 
END 


and similarly for subroutine MFWRIT. 


As discussed in sections 3.4 and 3.5 it may be useful to call MFREAD/MFWRIT with a ‘record’ 
length NB different from 2**#IBEX. This can give a user more logical access to a multidimensional 
array, in ‘records’ of first dimension length, for example. Some systems allow a redefinition of the file 


1,5-13 


FFT Programs Chapter 1 


structure, in which case the problem is solved. Others allow a ‘word-addressable’ file structure in which 
an I/O transfer may start at any word in the file. In this case, MFREAD/MFWRIT can include the fol- 
lowing: 


INDEX = (JB—1)*NB + 1 
(Transfer between file real element indices (INDEX) and (INDEX+NB-—1)) 


The dummy I/O routines of the universal test program of Section 6, and the CYBER Extended 
Core/LCM and PDP 11 Macro routines, include this feature. 


Subroutines MFREAD and MFWRIT allow the user considerable scope for modifying the operation 
of the FFT routines. In the universal test driver program (section 6) the subroutines simply copy data 
from one core store array to another. In some systems external core store can be accessed efficiently in 
blocks, which allows this to be used as a fast, static mass store. Using different files on the first I/O 
pass for MFREAD and MFWRIT allows data to be copied automatically from a source file to a working 
and result file. In this case care must be taken to allow only a single read of each block of the source 
file, any subsequent read, even on the ‘first’ I/O pass, being from the working file (important during 
complex-to-real transformation by routine RMFFT). 
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Table 1 


‘MFFT TEST) 
-1 IBEX = 


2 ICEX 


NAIVE 


0.160E 02 
-0.132E 01 
-0.971E 00 
-0.146E 00 
-0.187E 00 
0.141E 01 
-0.997E 00 
-0.319E 00 
-0.281E 00 
0.181E 01 
-0.111E 01 
-0.176E 01 
0.874E 00 
0.875E 00 
-0.255E 01 
0.204E 00 
-0.844E 00 
0.204E 00 
-0.255E 01 
0.875E 00 
0.874E 00 
-0.176E 01 
-0.111E 01 
0.181E 01 
-0.281E 00 
-0.319E 00 
-0.997E 00 
0.141E 01 
-0.187E 00 
-0.146E 00 
-0.971E 00 
-0.132E 01 


-1 IBEX = 


Oo. 
-0.638E 
-0.417E 
-0.306E 
-0.287E 
-0.123E 

0.296E 
-0.164E 
-0.134E 

0.166E 
-0.104E 
-0.452E 
-0.210E 
-0.220E 
-0.138E 
0.738E 
-0.330E- 
-0.738E 
0.138E 
0.220E 
0.210E 
0.452E 
0.104E 
-0.166E 
0.134E 
0.164E 
-0.296E 
0.123E 
0.287E 
0.306E 
0.417E 
0.638E 


2 = ICEX 


1 (1=COPIOUS,0=MAX DIFFS,-1=OVERALL) 


1 IBEX = 


DIFF 
0.373E-08 
0.745E-08 
0.745E-08 
0.149E-07 
0.186E-08 
0.745E-08 
0. 
0.149E-07 
0.745E-08 
0.373E-08 
0.149E-07 
0. 
0.745E-08 
0. 745E-08 
0.745E-08 
0. 149E-07 
0.373E-08 
0.745E-08 
oO. 
0.149E-07 


0.745E-08 
oO. 
0.373E-08 


IPRINT 
IRMF 
NDIM = 
MEXA() = 5 
INDEX FFT 
0 0.160E 02 0. 
1 -0.132E 01 -0.638E 00 
2 -0.971E 00 -0.417E 00 
3 -0.146E 00 -0.306E 00 
4 -0.187E 00 -0.287E 00 
5 0.141E 01 -0.123E 01 
6 -0.997E 00 0.296E 00 
7 +-0.319E 00 -0.164E 01 
8 -0.281E 00 -0.134E 01 
9 0.181E 01 0.166E 01 
10 -0.111E 01 -0.104E 01 
11 -0.176E 01 -0.452E 00 
12 0.874E 00 -0.210E 01 
13 0.875E 00 -0.220E 01 
14 -0.255E 01 -0.138E 01 
15 0.204 00 0.738E 00 
16 -0.844E 00 0. 
17 0.204E 00 -0.738E 00 
18 -0.255E 01 0.138E 01 
19 0.875E 00 0.220E 01 
20 0.874E 00 0.210E 01 
21 -0.176E 01 0.452E 00 
22 -0.111E 01 0.104E 01 
23 0.181E 01 -0.166E 01 
24 -0.281E 00 0.134E 01 
25 -0.319E 00 0.164E 01 
26 -0.997E 00 -0.296E 00 
27 0.141E 01 0.123E 01 
28 -0.187E 00 0.287E 00 
29 -0.146E 00 0.306E 00 
30 -0.971E 00 0.417E 00 
31 -0.132E 01 0.638E 00 
MAX DIFF 0.1989E-05 
NDIM = 1 ISGN = -1 IDIR = 
MEXA() = 5 
MASS STORE FFT TEST 
IPRINT = 
IRMF = -1 (O0=CMFFT TEST,-1=RMFFT TEST) 
NDIM = 1 ISGN= 1 IDIR = 
MEXA() = 5 
INDEX FFT/2+#M INPUT 
i) 0.194E 00 0.194E 00 
1 0.958E 00 0.958E 00 
2 0.135E 00 0.135E 00 
3 0.696E 00 0.696E 00 
4 0.233E 00 0.233E 00 
5 0,.465E 00 0.465E 00 
6 0.737E 00 0.737E 00 
7 0.516E 00 0.516E 00 
8 0.897E 00 0.897E 00 
i 0.981E-01 0.981E-01 
10 0.963E 00 0.963E 00 
11 0.461E 00 0.461E 00 
12 0.186E 00 0.186E 00 
13 0.856E 00 0.856E 00 
14 0.815E 00 0.815E 00 
15 0.532E 00 0.532E 00 
16 0.100E 00 0.100E 00 
17 0.739E 00 0.739E 00 
18 0,292E 00 0.292E 00 
19 0.727E 00 0.727E 00 
20 0.639E 00 0.639E 00 
21 0.747E 00 0.747E 00 
22 0.393E 00 0.393E 00 
23 0.474E-01 0.474E-01 
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00 
00 
00 
oo 
01 
oo 
01 
01 
01 
01 
00 
01 
01 
01 
oo 
07 
00 
01 
01 
01 
00 
01 
01 
01 
01 
00 
01 
00 
00 
00 
00 


-0.10E-06 


4 


4 


MSFFT 


DIFF 


oO. 


0.13E-06 
0.13E-07 
0.37E-07 
0.15E-07 
0.22E-07 
0. 18E-06 
0.17E-06 
0.22E-06 
0.75E-07 
0.30E-07 
0.13E-06 
0.89E-07 
0.15E-06 
0.16E-06 
0. 

0.16E-06 
0.30E-07 
0.27E-06 
0 .80E-06 
0.55E-06 
0.63E-06 
0.60E-07 
0.33E-06 
0.17E-05 
0.89E-07 
0.30E-06 
0.11E-05 
0.75E-06 
0.20E-05 
0.72E-06 


IPAK = 


IPAK = 


0. 
0.75E-07 
0.86E-07 
0.34E-07 
0.22E-07 
-0.1S5E-07 
-0.67E-07 
-0.36E-06~ 
0.30E-07 
-0.15E-07 
~0.36E-06 
0.22E-06 
0.30E-07 
-0.18E-06 
0.42E-06 
-0.47E-06 
0.33E-07 
0.22E-06 
-0.63E-06 
-0.60E-07 
0.60E-06 
0.46E-06 
0.39E-06 
-0.31E-06 
0.30E-07 
0.83E-06 
-0.55E-06 
0.28E-06 
0.12E-05 
-0.21E-06 
-0.53E-06 
0.37E-07 


1 
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Table 1 
(Continued) 
24 0.803E 00 0.803E 00 0.745E-08 
25 0.879E 00 0.879E 00 0. 
26 0.120E 00 0.120E 00 oO. 
27 0.493E 00 0.493E 00 0.745E-08 
28 0.592E 00 0.592E 00 0.745E-08 
29 0.137E 00 0.137E 00 0.745E-08 
30 0.471E 00 0.471E 00 0.745E-08 
31 0.630E-01 0.630E-01 0.745E-08 
MAX DIFF 0.1490E-07 
NDIM = 1 ISGN= 1 IDIR= 1 IBEX = 
MEXA() = 5 
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ICEX = 


4 IPAK = 


1 


Chapter 1 


MSFFT 


Section 1.5 


ana 
Nao 
b+ (L)WxaW = (L)¥XaW 
(XdOI “XSI ‘van ‘IvOS ‘HIGI ‘NOSI ‘WIGN ‘VXaH)LaaW TIVO 
(HN ‘@ ‘vaNd ‘AvVdI ‘HIGI *NOSI ‘WIGN ‘VXEW)dWO¥aW TIVO 
+ - (WIGN)VX3W = (WIGN)VXaW OL 


WHOASNVUL TV3¥-OL-XATaWOD *MOTSE 


NunLaa 

t+ (WIGN)¥xaW = (WIGN)VxXaW 

(HW ‘a ‘vdNd ‘AvdI ‘WIGI ‘NOSI ‘WIGN ‘VXaW) dWOWaW TIVO 
(X3OI ‘Xgl ‘van *IVOS ‘YIGI ‘NOSI ‘WIGN ‘VX3W)LaaW TIVO 
+ - (L)vxaW = (1)vxaW 


WHOASNVUL XB1dNOD-OL-Ivay *MOTSE 


OL OL OD (O"LO*MIGI) ar 
| - xaaI =a 
+ - (66‘WIGN'VX3W)WOSaW = HW 


(L)VX3W ‘@ YaOSLNT 
(L)van@ xaTawoo 


(L=avdI 42 (L+XS@I-W)**Z YO ‘Ivey aI (XS@I-W)**Z°aT'aC“aT"L) 
STvau GN ‘vdNG AYOLS 3YOO GNY SYOLS SSVW NAEMLaa ‘aC XBqNI ‘xO01d 
GINO USdSNVEL (GC*EN' Vand) LIUMAN GNV (a@C'aN'VaNd)avauaW NLNaNS ‘9a 
LIMMAW/AVEUAW SNIYGNS AG SSAIOV HOd NEdO BQ LSAW AVYUV SYOLS SSVW 


XTdWO (1-W)**2) BZIS aIVH ATLOVXS LY AVYUV XBT4WOD SQIOH L-=xVaI 
@2ZIS d'IVH USAO “SAC 40 AVYYY XATAWOD SALNAWOD O=xVAT 

(GaaWO SV SWVS) KONVGNNGEY T1Nd OL AVHUV XBTdWOD SGNVAXE 1+=XVdI 
'SOHL *MOLVNIWHSLEG ONINOVd AVY SI AVdI 


VaN@ GYOLS FHOD NI SINEWS1G IVa 4O YSEWON SI XBOIe+z 

XOOTE FHOLS SSVW NI SINGWATA IVa¥ 40 USBWON SI XaaI*+z 

SOHL ‘SLNSNOdXS GZIS 3402 GNY AOI UV XDI ‘xaaI 

(GAO@V ALON aaS) SSHXGdV SSVa AVHYVY ONIXYOM aYOLS aNOD SI vane 


(ANT We*2/"l ‘GMa ‘t=1VOS LES *94) LINSAY 40 YAITAILINW IvVau SI IvOS 
‘IVGU-OL-XATdWOD ‘1 +=HIGT 
XETdWOO-OL-Tvau *L-=¥IGI 

?SOHL ‘WHO4SNVUL JO NOILOGHIG SANIWYSLAG YIGI 

GNV *(- YO +) WHOdSNVUL JO LNINOdXE XA1dWOD JO NOIS SBAID NOSI 


SII VXEW GNV YAGYO NOISNAWIG S3SUSATU SAVMIV LaaWe 

lsHvdI HLIM LIONS XaTAWOD I ‘SENIVA XETEWOD Weez ‘YO 

“SSO1VA T¥au GaxOVd Weez ‘SOHL 
“SNVUL dO BZIS LOSddT SI WeeZ TUSHM ‘W = (C)VXBH 4O WIGN OL WOS 
SNOISNSWIG 40 USGWON 3HL SOHL GNV LSI1 NI SLNSNOdXd 40 ¥SGWON SI WIGN 
USuId INFOVCaY ‘(Zz ASV) SNOdXa 3ZIS NOISNEWIG 40 LSIT (£)VXaW 


‘van AVHYV YOd (XATAWOD YO IVaN) AMAL INTUZasIG 

“aS TIIM SENILNOWENS INTYS4dId ‘Lad SIHL NI ‘vaNd AVHYY ONTWYOM 
NVULYOd NI GNV SYOLS SSVW NI HLO@ ‘SLNEWSTE * *“OVWI/1VS4/OVWI/IVEE 
ONILYNUGLIV SV LSIXE LSOW VLVd X3TdWOD BdAL LYHL T1SM 3LON 


(iva . 
“XSOI 'XS@I ‘van@ ‘1VOS ‘¥IGI ‘NOSI ‘WIGN ‘VXaN)laaWe SNILNouans 


(MOTSE SLON 33S) VLVd XB1dWOO HO IVEY USHLIG SI AVWYV ZYOLS sSvW 
(60€-862 “dd ‘94 TI¥dv ‘Z°N‘EZ"A ‘WOV'C GNY ‘6461 - SWOL WOV ‘¥aSvua) 
AVUY AYOLS SSVW GSNEWIG-ILIOW 40 (VSHBA-FOIA YO) Lad X¥14WOD-OL-1Vay 

“aawa + 3NTLAousns 


vue 


evo 


VOLVO OYUVOVOVVOHVUUUOVUUULUUUUU0UL0U0U 


ou 


re) 
2 
2 
3 


“LIH/WLLXSH YO4 INILNOW O/I OMOVW “SVd 11 ddd LIYMaW/avauaM 9z 
(NDYENS N3dO OMDVW SCAN) WVHDONd ATdWVS O/I ONOWW ISVd 11 ddd sz 


gAOgy SV LIMMaW PT 
SENILNOW O/I SYOLS SSVW NVULYOd GUVGNVIS {1 dad aqvauaW €% 
WY4DOUd TIAWVS FYOLS SSVW Lt dad 72 


SANI“NOW O/I WO1/EHOD ASGNSIXA YAGAD LINMAW/avauaW Lz 
WVSOUd ATAWVS WO1/EHOO GAGNSLX UAKD 07 


ANILNOY O/I SOLS SSVW UAGKO LIYMAW/GVaYaW 61 
WVUDOUd FIdWVS SYOLS SSVW WAKO BL 


gAOaV SV 
SYOLS SSYW GSLVINWIS ONISN SNILNOY O/I AWNNG 
XIGAIVN GSLNdWOD WHOASNVEL USINNOA ALANDSIG @AIVN SL 
MOLVYENGD YAaWON WOGNVYE aWNVa PL 
(OSTY LL OL HL SGHSN ‘HOLS SSVW G3LVINWIS) WVHDOUd LSHL ‘IVSHAAIND EL 


arIumaw Lt 
aqvauaw 91 


S3NILNOWGNS O/I 3IdWVS GNV SWVUDOUd ISAL *NSHL 


(ANILNOWGNS SNNOG) ONTILAIHS NOISNSWIG JYOLS SSVW wagdWa Zt 
(G3GNaWHODEY LNG ‘IVILNESSG LON) SNILOOU Usd TaH uvadW LL 
AWOYAW WOd AYOLS 3YOD ONIGVOINN/ONIGVOT doTuaW OL 
ONITSWVHDS /ONITEWVYOSNN Xa'14WOO-IVau dWOuaW 6 

SNOILVWWOS LNANOdXa ()VXaW WosdW 8 

(NOILVLNWEAd ‘IVOLHIA) WHLIXODTV ONIXEGNI XO071E XONIGW 
YOLS 3YOD ONIGVOINN/ONIGVOT avolaw 9 

ONILHOS AXIOM SIOHM YO ONILYOS 3YOD-NT AgHaW 

ONILHOS JYOLS SSvW GYosan 

dad dxOO-NI aWOoaM 

(Xa1dWOD TIV) Lad 3OVHOLS SSYW HO ‘| AG GaTIVO Laawo z 
(LINS3¥ YO ViVd Ivau) Lad FOVYOLS SSYW GEZIWILGO waawd 


'LaS GNILNOWENS Lda BHL ‘Sula 
sWaCUO ONIMOTIOd SHL NI YVaddv SLINN WVUDOUd AHL 


"aHOLS 3HOD GNV aYOLS SS¥W 

HLO@ NI ***OVWI/IVSN/OVWI/TVaH GaYOLS aa OL GEWNSSY SI Viva 

X@1dWOO LVHL LON “USLEWVaVd IVWHOd V SV GESSVd SI LI SV AVHUY 

SWYS 3HL OL Xa T4WOD ZdkL YO IVEY G4AL USHLIT NOISSV SANILNOWENS 

ddd JONIS SUB TIdWOD ASSN4 AWOS HLIM NAXVL Ja AINOHS suv LNG 

“UadVd ‘IWWHOd BHL OL SONAYSATY HLIM GNV S@'IdWVXa FHL WOUd 
GaLOMYLSNOD ATISVE 3 AVA SWHLSAS WAHLO YOd SANILNOWENS O/T 


*SUMLNGWOOINIW 11 ddd Oaa 

Od ONY SUBLNAWOD YAGAD GNV 0009 VLVG TO¥LNOD YOa SENILNOGNS 

O/I GNY SWVHSOUd ZIdWVS ‘AVHYV NVULYOd VY HONOMHL FYOLS SSYW 
SHLVIOWIS HOIHM ‘WVHSO%d ISAL ‘IVSUSAINN V S3QNIONI 13S 3HL 


“8461 AINE :aLva NOISIAgY 


VITVaISNY ‘109% OV ‘ALID vauaanvo 
008l xom Od 
HOMVESEY ONILNAWOD 40 NOISIAIG ‘OUTS. 
4aSVUd GIVNOd =: HOHLAV 
dd JOVHOLS SSVW GAZIWILdO NY :WvuSOUd 


xipuaddy 


ou 


VCOVVYVVOVOVOVY UYU UVVOUUOD OU UU OULU UO UUUUUUUUUU UU UULULUUUUOUUN 


15-17 


svde - 9 = WaLI 

( (4a3a%+*0"2*dOWId* *0)xXTaWD) axa = a 

adiqu + svay = aagax 

(SVdu‘WIGN*VXaW)WOSaW - W = ZaIGx 

- - Svde + svar = svax 

SVaN‘L=Svar 08 od 

Fo) 
MSOGLNI TIVWS ONTGSSOXS LOOHLIM M ALN4WOD OL GES ZYv ION GNY GOWI 3 
Uda “NSWIGILION YOa M 40 NOILILGdTY SLNNOD LayN 2 
M AWVS ‘UIvd LXEN OL das ‘IENUaN Ldd NI SEN IVA S3Lvuvdas NvaS 5 
NOLOVd ASVHd M 40 NOILVOIAIGOW ZAISUNDTY YO GaSN SI a 2 
NOILVYSNGS M ddd "NSWIGILIOW HOd SSVd IVEOID SAILOGIIE SI 4agax D 
(TV9O1 SI L-Svdf) YEEWON SSVd ONILNdWOD TvEO1D SI svax D 
SHOO-NI VLVd STIHM SASSVd NOILVLNdHOD SVdN ‘MOTEE 


Chapter 1 


2 
Deez = ON 
GOWId- = GOWId (0°LT"NOSI) aI 
(W-L)**0°@eId = Gowrd 
(Odo"L)NVEVa * odo'y = Ia 
° 
/¥/ “STAT */0/ XANIT Viva 
(t)vand ‘a *M taWaL xaTaWoo 
(L)WXEW ‘daLS ‘NvdS ‘D ‘a W3OENI 
2 


SHONSNOSS M ONILVSdSY AG GFASIHDY Lad NAWIGILINW D 
SGNNO@ HOOT NO LdFOXA ATFAISUNDGY AELNAWOD YOLOVA SSVHd M Lda 2 
2 
(SvdI ‘SVAN ‘W ‘D ‘a ‘VaNG ‘NOSI ‘WIGN ‘VXaW)dWODaW SNILNOWENS 


----D 
(SUWIE XT4WD Ge*z JO SXOOTE NI ‘VANE BYOLS YOO NI SLWIE XTaHO D**z) 9 
SUW1a XaTdWOD WON OL ¥adax AYSH LaFOKE XFOI'XSGI OL LNSTVAINOS D'a D 
SUNZWHOO LddWY NI SV ONINVSW SWVS ZAVH W GNV Vang" NOSI ‘WIGN ‘vxaW > 
SVdI HLIM ONILUVLS SASSVd SVAN ‘SENSWS1S O+*z JO Ldd SHOD-NI ‘aaraIqoW > 
aWOOgN :NILNOYGNS 3 


Pensisie ny nee reo 
2 
ang 
NunLau 
SQNILNOD 001 
(TWHaW “HI ‘OI *XSOI ‘xa@I ‘vana)Luosaw T1vd 
(£)¥XaW + HI = HI 
HI = 91 
WIGN'L=P 001 oa 
L=HI 06 
2 
(IVSUSATY NEWIG ON) AISLVavaaS NSWIG HOVa 4O SLI@ asugagu ‘Moiaa > 
2 
NuoLae 
ro) 
(GSI1 VXaW 3SHaAga GNV) SLI@ W dO ‘IVSUaAgU-1IG TIna oa 3 
3 
(4-"WIGN'VXaH) WOSaH = W 
(IVdaW ‘IVEYW ‘1 ‘xdOI *xaaI ‘vana)Luosan TIVO 
06 O% OD (O*Oa"YIGI) aI 08 
3 
(O°GN"HIGI 41 IVSUSATY NEWIG GNV IVSUZASY-LIG TIn4) AVUYY LYOS ‘MoTEa D 
= 
H 0S OL 09 
(91aI ‘XSOI ‘XaGI ‘vane ‘LIMMT)avOTaW TIVD 01 
& SQNIINOD 09 
avos*(c)vana = (c)vane 
E ON'L=L 09 oa 
O04 OL OD (*L*Oa"TVOS) aI 
me Fe) 


¥O1-340D HOVE 40 Lad 3HOO-NI SSVd-D ‘IVNId Oa 
= 
(Svd4I ‘D *W ‘D ‘D ‘Vana ‘NOSI ‘WIGN ‘VXaW)4WOOaW TIVO 
08 OL OD (O°LI"D14I) aT 
(914 ‘XDI ‘xagI ‘vane ‘avaw1)avolaw TIVO os 
=) 
SMOTI04 NOILVLNGWOD Lda NO XOVLLY ONIGNIONOD ‘IVNIG 9 
2 
(O*W‘W'@‘LaST)XGNIaW = WOGI OF 
(Wadd ON) W3qYO aNUL NI LYVd LXAN NI ava 3a OL sxD01a AaIOgaS 


Guvd LSuId 40 aNa 


vouou 


0} OL 0D 
SVdN - SVdW = SVdW 
SVdN + SVdI = SVdI 0€ 
0z OL 09 


SYOLS SSVW OL SOVId-NI AOVE SXOOTE ONILINM ‘va¥v SHO avo1Nnn 
(oar 


*XdOI 'XSGI ‘vana ‘LIYM1)avoTaW TIVO 


SvdI HLIM ONILYVLS SSSVd SVN ONIMINOSY ‘dd AYOD-NI GaIaTGOW oa 


voe vvy 


(S¥dI “SVdN ‘W ‘D ‘@ ‘vaN@ ‘NOSI ‘WIGN ‘VX3W)dWOOdW ‘TIVO 
O€ OL OD (O'“T'OTAI) aT 


XGNI4W OL ONTGHODOV SXOOTE (G-D)**e HLIM FOvdS ONIAYOM FYOD avor 


vou 


(914I ‘X91 *xXaaI ‘vana ‘avay1)avolaW Tivo 0z 
SVdW = SVdN (SV4N"LI‘SvdW) JI 

OF OL OD (O'SI'SVaW) AI OL 

SMOT104d NOILVLNAWOD Lad NO NOVLLY IVEW-SOaId ‘Lsura 

NOILVLOWNSd (H-D)**(W",S."H) IVNLYTA AdTOSdS OL XGNIGW OL TIVO AWWNG 
(SVdN‘W'W'a'2aS7)xXGNIaW = wnat 


dvOl Wad SESSVd @-5 Od OL SAIML - FHOLS 3HOD dO JSN LNAIOIaaa SOW 


yuu voove 


= Svan 
W = SvaW 
0 = Svar 

Deez = ON 

b - xgor = 0 

. - xXaaI = @ 

b+ W = IvauW 
(66'WIGN'VXSW)WOSaW = W 


a 
2 


/t/ LIMMT */L/ GVEAT */1/ LAST viva 
(L)vxaW ‘O ‘a ygoaLNT 
(1)van@ xaTawoo 


(X29I “X@GI ‘¥aN@ ‘IVOS *HIGI ‘NOSI ‘WIGN ‘V¥XaW)adWO ANILNONENS 


| 
GaS¥3Agu LON av (LSI1 VXSW CNV) YSGHYO NOISNSWIG ‘O=¥IGI aITHM 9 
GaSHaAae YAGHO NOISNEWIG ‘Xa1dWOD SAVMIV AVEAV ‘1- HO L+=4IGI od 9 
Ld39X3 ONINVEN SWVS ZAVH SLNAWNOYV !LadWY NIYGNS FES ‘SLNEWWOD Od O 
“aaWY YO BESN AG GETIVD ‘AVYYV HOLS SSVW GSNSWIG-ILTNW JO Lad XaTaWOO 2 
daW2 :3NILNO¥aAS Oo 

-3 


1.5-18 


MSFFT 


Section 1.5 


}'L5*(DI+XSGI*Z-HI) 4I ‘SYOLS SSVW NI SNOO0TE 40 “WYad ,Y, IVNId ‘MOTSE 


“ava Lsula 40 aNd 
OL OL 09 
SVAN - SvaW = SvaW 
SVaN + SVdI = SVdI Of 
0% OL 09 
SHOLS SSVW OL SOVId-NI OVE SYOOTE ONILIUM ‘VEuV ZHOO aVOIND 
(OT4I ‘XSOI *xSeI ‘vane *LIUMI)avOTaW TIVD 
(SSVd LSYId NO AINO 3NO) “SWH3d Y OIBLEWWAS ‘YOD-NI LNO ABYVD 
(t- *xSOI ‘SvdN+xgeI ‘4OODI ‘vang)AgYaW TIVO 
(t- *XSOI 'XS@I ‘WOODI ‘vaNd)ATYAW TIVO (0°SN'SVdI) aT 
O€ OL OD (O°LT"O14I) aI 
(O14I *XHOI ‘xSGI ‘vane ‘avaw1)avOaW TIVD 0z 
SUW1d WHEd ONY NOTLVLOWESd IVALYIA OL ONTGYODDV aYOD avo7 ‘MoTaE 
WHSd SVANe*(HI'S*XSGI) IVOLUIA AdIDGAS OL XGNIAW OL TIVO AWNAG 
(SVdN*W'HI‘X@@I‘Wuad1)XGNIAW = WOOT 
SHSVD ‘IVIAIWL 41 GVOT 3HOD AUVSSHOENNN ssvaag 
O€ OL OD ((t-SVAN+XBGI"LD"YODIDI) “ANY (O"OS"SVdI)) aI 
O€ OL OD ((L-SVdN+XBaI'LO'HODDI) “GNV’ (1-X¥aI"LO"HOODI)) aI 
SVdI + OI = HODOT 
SVdH = SVAN (SVdN‘L1'SVdW) aI 
OF OL OD (O'ST'SVaw) 4I OL 
SNOLLVLOWSSd ,S, IVNLHIA LSUId ‘MOTSa 
OI - XI = S¥aW (SVdW"L1°9I-xaaI) aI 
xgGI - HI = svaw 
xaaI - Xd01 = svaN 
0 = svar 
avo1 uaa 
SaSSVd XA@I-XBOI Od OL SAIUL - aYOLS AOD dO GSN INAIOIdaa LSOW 
SNOOTd ONY SINSWS1 HLO@ 4O NOILVLOWNGd G3XIK ‘MOTSa 
INEWLVUL WATAWIS ONIYINOTY ‘SESVD IvIOgdS YOa YOSHO 
09 OL OD (Xd9I‘aI"HI) aT 
0S OL OD (XdaI"gD"DI) aI 
NUOLSY (4'ST'OI-HI) aT 
(AVHMY GELAWYAENN ATIVILINI) XGNIGW ASTIVILINI 0% TIVO AWWOG 
(O*W'W'XaaI*LaS1)xXaNIaW = WOdI 


7t/ GIMMI */1/ GVaaT ‘/Z/ WESdT */1/ LAST viva 
(t)vana Ivae 


(W ‘HI ‘OT *XSOI *xaaI ‘vaNe)Luosaw SNILNOwanS 


ddWa NI SLNSWWOD NI SV ONINVSW 3WVS ZAVH W GNY XdOI‘xgeI‘vang 
“SLIWIT LIG GSYSLIV HLIM ‘SWVS 3HL ATIVOIDOT SI WHLINOOTV Log 


3} vove 


evo voove vue ovo 


vou 


vuvoven 


vovuoe 


‘(90€ “d ‘94 "Mdv ‘Z'N ‘EZ*A ‘WOW'r ‘NaSVEd) SONTUTETY dO O 
‘IWSUSASY LIG-W TINd 3HL NVHL ‘IVH9NS3D SHOW SI SIHL LVHL 3LON 2 
(o**** tort" **L-HI***"*{-W) XSGNI NI SLI@ SI-HI sasugagy 
AV4Y IVEY FYOLS SSYW 4O (HI*,¥,'OI) NOILVLOWHSd GISUTATU-LIA O 
“HOSaW :SNTLNOWEAS O 


ee ee i Peep eh Ba 
Fr 
ana 
NunLaa 
SQNILNOD 08 
SQNILNOD = 04 
3QNILNOD 09 
2 
SAIWVGNNOG AOOTG NIHLIM M 4O NOILVOI4IGOW BAISUNDSY 9 
2 
aem =m 
2 
(LNaWOD SKOTIOd IVSUSASY-LIG WHITYODIV) OILAWHLINY TENYEX LNIOd-z Lad O 
S 
SQNILNOO os 
ANNILNOD oF 
aWaL = (x)vane 
(i vane + (c)vang = (c) vane 
Me ( (i) vane-(2)vand) = aWaL 
NVdS + f= 
a3LS'ON'PI=L OF Oa 
B) 
ad N3WIG 3NO NI M HVS ONIAVH SZOIGNI HOMOHL ONIddgLs ‘MoTga 3 
3 
Z- €1 + 2x + r= pr 
UdUN‘L=EI 0S Oo 
2 
Gad NSWIGIUINN OL 3Nd M BWVS 40 NOILI“GaTa ‘MOTEE O 
= 
La¥N*GN'L=2T 09 0a oc 
2 
SLWIE XTdWD Ge*z 40 XOOTH HOVE NIHLIM SNOTLVLNGWOD ‘MOTE 2 
es 
Vauv ADOT MEN dO ONINNIOSG LV AILOGYIG GgLNAWOD M MEN O 
Es) 
((WMaNV+zaoWrIa**0)xX14W>)4xao = 
WMGNI = WMGNY 
WION/ (GOWT* L~(0*0"0"O*XGNIT)XGNIAW)GOW = WMGNI 
Q€ OL OD (L’aT*GOWI) aT 
Fel el Bate 
QN'NYAS"L=1I 04 OG Oz 
B) 
SATYVGNNOG XOOTE ONION ‘d¥OD HONOUHL SSVd BNO dO LUVES ‘MOTE D 
2 


axaW**0'Z*dOWId = ZdOWId 
WALI**Z = WION OL 

0 = WILT 

SvaX + @ = dXaw 

OL OL OD (O°LO*WELI) aT 

@ - 4aIGN = WaLI 

4agdx = dXaw 

(0‘0'O‘O*LSauT)XGNIaW = WGI 

0% OL OD (4*ST*GOWI) aT 

(L-SVa¥-a-W)**Z = GOWI 

WALI**7 = Laan 

a4a1d4 = WALI (4aIGy"LO‘WHLI) aT 

WaLI**Z = GN 

@ = WELI (WHLI°LI‘a) aI 

NvdS*z = dais 

WaLI**z = Nvds 


1.5-19 


Chapter 1 


$4001 NOILILSdau ‘USNNI dO GN 


SOQNILNOD 09 
SQNILNOD os 
SOQNILNOD ov 


(4€NI “GN *(LEN)VaNg)LIuMaN TIVO 
(MENT ‘GN ‘vana)LIEMaW TIVO 
(MENT ‘GN *( LEN) Vang) avauaN TIVO 
(4€NI ‘GN ‘vane)avauaN TIVD oc 


HOLS SSVW NI SXD01G SIOHM ONILHOS ‘MoOTaa 


OF OL 09 

aWaL = (4€NI)vang 
(4€NI) Vana = (HENI) Vane 
(4ENI) Vane = awa 


ONILYOS LNSWETS JYOO-NI ‘MOTaa 


O€ OL OD (O°aD*xaaI) aI 
@I + MZNI = WENT 
@I + 4@NI = a€NI 


SUYVd AVYYY YZAO NOILVLNWUSd SWVS 4O NOILILSaSU 


HN'SUVdN*L=ZI OF oa 
LI + dOMI + ASUI = YZNI 
LI + d0a4I + wOal = azNI 


SUNEWI1E IVNLOV ON dO LNEWATE YadNS YO dNOUS YSAO NOTLILadaY 


ON‘L=1T 0s oa 
(40¢)Vd0¥I = 40uT 
(40f)va0aI = 40at 

dON‘L=40¢ 09 oa 


(SuIvd € YO | YSHLTS) SUIVa aVMS XINO-3ONO SLOaTaS 
b= 4ON (AaHI“S9°YOsT) aT 
€ = 4ON 02 
(ZaS ()VUI 40 ,dOL, SI ASAI) AVMS GNV SUIVd XZQNI SLVUENEO ‘mOTaE 
0 = AguI 
0 = 4OaT 
SHIUAS HLONGT T1Nd OL UILYVNO LUZANOD OL SLaSa40 40 SuIVa aguHL 
| - ON + Z/HN = (€)vaour 
4 - ON + Z/HN = (€)vaoaT 
t- = (Z)vaour 
t- = (@)vaoar 
L - /HN = (1)vaour 
L - ON = (L)vaoaT 
v/HN = AUN 


G9SIIVILINI SLaS NOISUNOSY USOTINI aISUsAsY 


SOQNILNOD 01 
AgEN = (£) VEN 
Z/ATUN = ATEN 
0 = (£)var 
SHI*L=£ OL OG 


vou 


evo vvu eve 


vou 


eve 


vou 


vou 


v/HN = AgUN 
L + HN - WN = suvaN 
We*z = WN 


AZIS NOILVOIIdga NOILVLOWHGd SI HN ‘3ZIS dNOUD LNSEWEAOW SI ON 


@/HN = 4HHN 
HI**Z = HN 
Z*ON = GGON 
OI**z = ON 
L + GN = 1aN 
xXdGI**Z = aN 


dguINOsy NOILVLNWNTd ON 


Nanay ((Z-)*aT*OHT) ar 
€ - OI - HI = SHI 


(€)vdour *(€)vadOaT *(9L)VEN *(9L)VUI BFOTLNT 
dWaL ‘(1)vane Ivau 


"0 OL t-9I GNV HI OL W SLIG GSLNWYSdNN AHL OL ONTGNOASaHHOD 
“AVHUV SHL 40 SLYVd (HI-W)**Z YSIAO GALVadaY SI SIHL ATIHM 
MSHLZSOL AZAOW FUV SLWIE Ol**z 40 SdNO¥D ‘SdOO1 YANNI 3H“ NIHLIM 


HOVE € YO |) GSLVYENED AYV SYIVd dVMS GIIVA XINO ‘OVS IVNId SIHL NI 
“SLaSdd0 ONIGGY GNV Z AG ONIIVOS AG GSAIUTC HLON T1Nd aHL ANY 

(SUI@ @-) G&LVYEND TYV SALWS HIONST YILUVNO AINO ‘NOILIGGY NI ‘LOG 
“TIVWS ZOVUIAV NO BUV SHId3d NOISUNDY SV ‘ISV4 SI a1SSLI NI SIHL 
“AIZAISUNOGY *KHOUVESIH HL NI YSOTLINI GISHIATY AILNSWAYONT 

MSMO1 LX3N SHL X@ LNEWSOVIdae HO *()VHI OL ()VYN 4O NOILIGAV 
SLVNYALIV SHL SIYINOTH NSHL YIOILNI GISUIATY V ONIGNAWSYONT 

“SLI@ (OI-HI) NVHL SS31Z OL dN ‘SLId dO MSHWAN ONISVSYONI JO 

()val AVWUV NI SHBOSINI ,GaSHaAaX, 4O LAS V SNIVINIVW WHLIYOOTV JHL 


(xaaI ‘W ‘HI ‘OT ‘vana)AgYaW SNILNOWENS 


(ASV9 GNODZS NI SHOOTd Weez GNV AOC UId SIWIA Ivau xaGI++z) 
SYOLS SSVW NI SXOOTE SLYOS *O'D'xXaaI aI 
“‘vaN@ 3HOD NI SWI ‘Ivau Wee? SLHOS ‘O°LI'xaGI aI 
(O0€ “a ‘9461 “e°N ‘€Z°A ‘WOV'C “HESVHd ‘HI*,Y,’OI Wad TVYINGD) 
(0 ‘or ‘L-HI‘****t-W) XSGNI NI SLI@ OI-HI sasugagy 
SINSW31a JIAVSSIUCGY ATWOGNVY 4O NOILVLOWNSd AsUTATY-LIG 
AguaW + SNTLNOWGNS 
ana 
09 OL 09 


(9141 *XS9I ‘xaaI ‘vane ‘LIUM1)GvOTaW IVD 
(t- *XSOI ‘HI ‘oI ‘yvana)AguaW TIVO 
NUNLY (0°LI'OET) ar 

(QT4I *XSOI ‘xXSaI ‘vana ‘avauI)avolaW TIVO 09 


Ga¥INOSY AINO SYOO NI SUNSWE1S 4O NOILVLOWYSd ‘moTsa 


Nunta 
(Xa@I “Xa@I-W ‘XaGI-HI ‘xaaI-DI ‘vana)AgYaW TIVO OS 


dauINOsa AINO SHOO1G 40 NOTLVLAWHSd ‘MOTIa 


NuoLay 
(XaGI “XSGI-W ‘OI+XSGI+Z-HI ‘0 ‘vaNa)ATYAW TIVO OF 


ove 


ovo 


VOYVYOULLOULG VOULLOLULVYLULLUUVLUN UV 


vou 


vou 


1.5-20 


MSFFT 


Section 1.5 


AVYMY 40 SLUVd (H-W)**Z NO SONSNOSS Lvaaay OL GgUINOTY ad0L*LaUN 


NUQLTY (0°LO"LAUN) aT 
L - daun = Laan 
b+ AVE = AVC (GHN"ED"AVX) aT 
(@HN‘AVH) GOW = AVE 
a43LsI + AVE = AVX 
0€ OL OD (@WN*LO‘XGNIAW) aI 

440f + AVE = XGNIAW OL 

XONI4W LXSN 40 NOILVUSNSD IVWYON ‘MOTSE 0Z 
WaadI+*z = daisr 
WHadI + GHI = WHadI (O°LI'WHadI) aT 
(GHI‘WHAAN-WYSdI)GOW = WHEAT (0'LO'WHRAN) AT 


SSvd Vv dO XGNI4W LS¥Id Saqgogua *MOTIE 
OL OL OD (O°SN"aSLSI) aT 
06 OL OD (p*'Oa"OadS1) aT 
O£ OL OD (€°OR"DadST) ar 
09 OL OD (Z*Oa*Oads1) aT 
0S OL OD (L*Oa"DadST) aT 


H *@ UsORLNI 
WHadN ‘daISI ‘HI ‘aWN . 
“@HN ‘HLdHN ‘HdOf ‘HAVE ‘WHSdI “LdyN ‘440° ‘AVE /AVIMVA/ NOHHOD 


(@¥GH SAIWHNd N‘W‘H'G) QIOHT LSV1 OL ALVIS SHYOLSEY (LSaU1) p=oaas7 
(3WaH SGIWNNG N‘W'H‘G) SLVLS ONIXAGNI LNEYYND SGIOH (QIOHT) €=oadS7 
SUSLGWVaVd N‘W'H'G GHL SONVHO (WHSd1) Z=Og9dST 

SHVUVd N‘W'H'G SUSLNG ‘(GSWYadNO) O=WHSdI SLES (13ST) |=OgdST 
(3¥SH SHIWWNd N‘W‘H'G) X@GNI YOd XONIAW SNUNLEY (XGNI1) 0=9aaS7 


Sivaday (H-W) 


*@ ONTUINOSY ‘W dO GVALSNI H GNNOs wadan 3LON 
WHLIMOSTY 40 ,x, GNV ,£, FV AVM GNV AVE 
WHLIYOD'IV dO ,d**0, SI daLSI 

WHLIYOOTV 4O ,N, SI (LNSWODYV) N=WuadN 
WHLIWOSTY 40 ,d, SI WagddT 

#SMOT104 SV SAWVN STSVIUVA 3LON 


(N ‘Wo 'H ‘a ‘OgdS1)XaGNIaW NOILONNG 


(SLAIHS LHOTY N-) SSVd O/I Wad SLAIHS Lag 4O USGWON FAILOGAAT SIN 
(W'AT*H'AT*G°d1°O) W NOdXa FYOLS SSVW ‘H NOdXa BZIS X90718 
Nee(H',S,°G) Wudd ‘GVOT 3HOD IVIINENOSS YOd XSGNI LX3N SALNAWOD 


Cotte tates s*t-H*****t-W) X@ONI NI SLI@ G-H SLAIHS DIT949 
(€0€"d "OL “HdV ‘ZN *EZ*A ‘WOV'D ‘UaSVEd) NOILVLOWYGd ,.S, TVNLXIA 
XQNIGW :NOTLONOG 

ana 

Nuoiae 


(3ONENOSS GVENAW Lvadae) XSGNI XGNIZW IVOLUIA LXSN HLIM ¥OOTE SILTUM 


(ge ‘aN * (1+) Vana) -IuMaW TIVD 

(0*0*O*O*XGNIT)XGNIaW = ar 
@Ne(1-c) = % 
GON*L=C OF OG 

(0*O*0*O'<Sa¥1)XGNIAW = WGI Of 


vou 


vou 


vouvuovvouLvKu00”U 


vou 


AOOId SOVId-NI dO LUVLS OL XGNIAW SLaSau 


NwoLay 
t- = O14 0z 
NUOLTe 
@QNI“NOD Ot 


XSQNI XGNIAW ‘IVOLYIA LXSN HLIM XOO1a savay 


(ae ‘GN ‘(1+x)vana)avauaw TIVS 
0Z OL OD (O°“T"ar) ar 
(0*0'O*O*XGNIT)XGNIAW = aC 
@Ne (1-0) = % 

GON‘ }=£ OL Od 


aWODdW NIMGNS GNVY Z AMINA HOd SNIVA XGNIAW INAWYND SaTOH 


(0*0'O*O‘GIOHT)XGNIaW = WOOT 
i+ = OTaI 

O€ OL OD (Z*Oa‘avo1) aI 
(XS@I-XGOI)**Z = GON 
xaaie*z = aN 


7¥/ GSAMT ‘/€/ GIOHT */0/ XGNIT viva 
(i)vana Iva9H 


(2141 ‘XSOI ‘xaaI ‘vane ‘avo1)avo1aW aNILoo¥ans 


YOLS SSVW OL OVId-NI NOVA SUOOTE SALIUM (LIMMT) Z=avoT 


V4N@ ZHOLS FYOD OLNI SHOLS SSVW WOUd SHIOId Sava¥ (vay) L=avoT 


XGNIA4W NOILONN4 NOILVLOWNSd ‘IVOLYIA OL ONIGHOIDV GEXGNI SxOOTE 

¥OLS SSVW dO SSVd GNO G3HSINI4 NAHM |-=D1dI ‘ATIVWHON |+=97d1 SNUNIGY 

MOOG UId XAGIe+Z ‘SVEN XFOI+*z ‘VANG AVYUV FHOLS JYOD SaVOINN ‘SaVvoOT 
avolan : 


(2)VaN + (C)VaI = (C)vaI 06 
AHOUVESIH NI YAMOT ‘HSOSLNI SHEATH 4O LNEWEYONI @IdWIS ‘MOTE 
@ONNILNOD 08 


06 OL OD ((f)VAN'LI'(C)vuT) aT 
OHI'L=£ 08 OG OL 


S3IUaS GASHIATY HLONSI-¥ALYVNO OL NOILVEALIV FAISUNDTY ILVNUGLIV 


0% OL OD 
AGN + ATUI = ATUT 


@*ON AG GHIVOS AGVANIV SI USOGINI HLONST-¥aLUVNO ASUTATU LVHL LON 
(MOISE ST4WIS) ONIINSWEYONI-3SYSATH 4O SCOHLEW ALVNUGL IY YO LSIL 


04 OL OD (ASUN"ED‘ATUI) aT 
NUOLAY (4HHN'aO‘YOdT) aT 


(Z*ON AG GHIVOS AGVENTV) YAOTLNI HLONST-aLAVND GUVMYOd LNAWIYONT 


GDN + HOdI = Hoa 


vo 


eovovvvue”K 


oor 


wove vo vvo 


veo 


15-21 


(WIGI)VAVH + GWON*AVX = AVX 
(WIGI)VAVE + GWON*AVE = AVE 
AVM = (WIGT) VaMH 
Ave = (WIGT) vaMc 
(WIGI)VXaW*+Z = GHON 

OF OL OD (L*OS"WIGI) aI oF 


_ WIGN = WIGI 
5 0 = Ave 
2 O = xVE oz 
& 2. 
6 “ dO MS3IdIGOW JAISUNDTY SI d *HOLOVa aSvHa X3TdWOD SI MD 
i 
(Q)9£2NOD = d (O°LI'NOSI) aI 
((((WIGN)VxaW-)**0°Z*Ia**0)x1aWD)axzd = a 
Cot) =m 
0 = OaMI 
2 
(avai NO SaNadgq) ag¥INoOa¥ XSGNI XOO1E WOWIXVH SI xvWar > 
2 
0 = xvWEr (O°LT"yvaI) aT 
t= xXvWar (O°LI"xvW) aI 
XVWe*z = xvWEar 
@ - W = XVM (O°LT'MVareurarI) aT 
(WIGN)VX3N = @ - W = X¥H 
(G-W) +*z = aoac 
@*aN = gcENn 
deez = aN 
+ = GNdxar 
2 
Q3OUaZ SHDIGNI OTMLSWHAS-SLVONCNOD “NAWIGILIOW 3 
2 
SANILNOD 01 
0 = (WIGT)¥AVa 
0 = (WIaI)vAve 
WIGN' L=WIGI 01 oa 
FY 
(0G0"L)NVaVa * odo'® = 14 
/\-/ WIDOT */%/ Baan *71/ BaMOT viva 
2 
GaYINOTY JI ASVEYONI - SNOISNEWIG b OL aN MOTIV VXMN‘VAMC*VAVE' AVE 3 
2 
(CLVXEW *() VIM (Cb) VAMC *(h)VAVN ‘(p)VAVE ‘a usOgENT 
(L)vang ‘a ‘Mm ‘aWal ‘WaLa ‘WaLV xaTaHOD 
2 


(W ‘@ ‘vand ‘AvdI *YIGI ‘NOSI ‘WIGN ‘vxaN)dWO¥aW SNIZNONENS 


*“SLW1G XB1dWOD We 
SVdUV NOISNVaXd soa 


% dO @ZIS AVYYY NOLS SSVW IVLOL 2 
-WdddO, ‘,4aMO1, *W4N NI X1dWO Fe(Ge*z) SasN > 
“3201 GYOLS SSVW NI SLW1A X31dWOD a+*z Log D 
SINSWHOD LddWa NI SV ONINVGN SWVS ZAVH SLNAWNOYY LSOW D 

T4dWY NLYGNS AG GATIVD ‘VSESA-3OIA YO Lad XSIaWOD-OL-IVaY SATEWVYDSNN > 
?3NILNOwENS 2 


ana 
nuniay 
SOQNILNOD 0% 
(oD vxaw 
(c) vxaw 


WELW = 
QD vxaw = 
(2) vxaW = WLW 


f - | + WIGN = x 
HWIGN'1=C 0Z Od 


Z/WIGN = HWIGN 


FFT Programs 


SIT VXEW dO WACO aSUaATY ‘MoTSa 2 
2 
NUNLEY (0'SD"WITW) ar 
GQNILNOD 01 
NUOLTE ((WOSAW*LI'WITH) “GNY* (0°SO°WITW)) aT 
(I)vxaW + WOS4W = WOSaW 
f£- t+ WIGN = 1 
WIGN‘L=C OL oa 


NUOLaY (O'ST'WIGN) aI 
0 = wnsaW 


(L)VxXaW YaOSINI 
Fy] 

(WITW “WIGN ‘VXSW)WOSAW NOTLONDA 
2 
gece} 
(SIT VXaW dO YAGYO SESURATY ‘IVLOL W SNUNLSY ‘SAILVOSN WIT 4I) > 
(S3N'IVA WIGN HOd IVLOL W SNUNLAY ‘HONONT 3OYVI WITW 41) 2 
(WITW'LO LSNL*WASAN) ONINUNLEY ‘YaqNO 3SUIATY NI LSI VXSW SNYOS D 
WOS3W :NOILONNG 0 
eee ee eas, 


2 


ana 
08 OL oD 
H&dUN = Layn 
Haor = 4a0r 
HAVE = KVCE 06 
ro) 
QIOHT LSVI LY XGNI4W XSGNI OL SUSLEWVYVd SHYOLSIU (LSAY1) p=ogas1 > 
5) 
Nungua 
WaadI = XGNTaW 08 
dun = Hidun 
a40c = Hor 
AVE = HAVE OL 
2 
SUSLSNVUVd ONIXSONI XGNI4W LNSYYND SQIOH (QIOHT) €sdgaS71 9 
Fe) 
Ov OL OD 
WagdI = xaNIaw 
(-W) **Z = @WN 
@HI**Z = gHN 
N = WHadN 
@- H=* gHI 09 


Fe) 
(@¥GHMaSIa SAIWWNG) SUBLIWVYVd N‘W'H'G SHL SZONVHD (WHEd1) z=oaasT > 
2 
0 = WHadI oS 
E) 
SWVUVd N°W'H'G SHSLNG *(GSWYSdNN) O=WUSdI SIS (LgS7) 1=daas1 3 
re} 
0z O41 0D 
0 = agusr 
L = agor op 
L- = XaNTaW 
(GHI'WHSEN-WHSdI)GOW = WHSdI (O'LI'WHSEN) aI OF 
a 
ASUSANI 41 GSUSLIV WHadI ‘Lasau Suvd ‘SSvd JNO 4O ANZ ‘MOTI OF > 
Fo) 
nunnay 
0 = ave 
@HN = LaN 02 
@HN + a40f = aaor 


1.5-22 


3 
SNILNOWGNS WOUd NEOLEY GNY dN AGIL ‘SLa1dWOD NOILVaEdO *MOTEE 
3) 
0% OL OD 
Po) 
SUIVd XHGNI OIMLEWWAS-ALVONCNOD “NSWIGILIOW dO ONIddaLS AAISUNOTY 9 
=) 
(WIGI)VAVe - GWON = (WIGI)VAVa 
t+ (WIGI)vAVe = (WIGI)VAVE OEL 
F) 


MSFFT 


OLL O% OD (t*Oa*(WIGI)VAVH) aI 
OLL OL OD . 
(((WIGT) VAVA+GWON® (WIGT) AMM) "OF" ( (WIG) VAVC+GWON® (WIGI) VME) ) aI 
O£L OL OD (O°OA*(WIGI)VAVC) 4I OZ 
B) 
dd “N3WIGILIOW dI M 40 NOTLVDIA4IGOW ZAISUNDTU 9 
2 
dem =m 
L = O4aMI 
OZL O% OD (WIGN*’SN‘WIGI) aT 
O¥L OL OD (L*aT"GWON) aT 
(HIGI)VXaW+*Z = GWON 
OL OL OD (WIGN'LO“WIGI) aI 
t + WIGI = WIar 
0 = (WIGI)VAVX 
0 = (WIGI)VAVE OLL 


AMLAWNKS-ALYONLNOD "NGWIGILIAW SLA4WOO OL NOISUNDaY ‘MOTEE 


L1dWOD NAWIG INSYUND ASIMYSHLO *SIGGIW IVOIMLAWWAS SG3N AVX"OS*AVE 


vovoue 


09 OL OD (AVX'OS*AVE) AT 
0S OL OD (O°LO"LNOTEN) at 
4 > GNOTGN = LNOTEN 
SHOO1G MAN dvau O% AYINOSY AVW ‘MOTaE 


(3AO@V L=€£ NAHM JSVO IVIDgdS ALON) dOO1 Y3NNI 4O Na 


vuuun 


08 OL OD (XIGMAN*LO‘LNON) 4 
04 OL OD (L*Oa"Er) at 


NWId LNEYYND NI SLA IdNOD NOILVHSdO 4I SNILNOU NOTSUNDaY YaLNI 


vou 


OLL OL 09 (0°ST°LNON) AT 
t= GNON = LNON 001 
2 
WHOASNVUL “NAWIGINO aI M 40 NOILVOIAIGOW ZAISUNDTY 9 
2 
am =M 
L = 94aMr 
0OL O% OD (WIGN*SN*WIGI) 4I 
) 
SNOILOGUIG ONISOddO NI dadd3Ls SIVd XBGNI aYOO-NI 9 
Fe) 
€f - ONT = Ex 
t+er= er 06 
2 
(WHLY)OCNOD = (1) VANE (O°LO"GNdXSI) aT 
(WHLG)OCNOD = (4) vane 
OLt OL OD (0°Oa"DaMI) AT 
WaLa = (Cf)vanG (0°L9"GNaxaI) aT 
wWaiv = (c)vang 
W3Ld - dWaL = Walg 
Wald + dWaL = WILY 


Section 1.5 


MoS" O*(( (WEEE) TVau* (WELE)OVWIV)XTdWO) = Wale 
((¢)van@)9ceNno2 - (x) vane = Wale 
$*0*(( (4) Vane) DCNOd+(f)vana) = aWaL 


Lad X31dWOD-OL-TWaY HOA ONITEWVEOSNND ‘MOTE 


002 OL OD (0'L9"uTGI) at 
@qgN + X= 3x 


gqENn + c= cr 
ex + 2d =x 
ec+etr= ef 08 


WOO NI SYIVd DIYISWWAS-SLVONLNOD XSGNI X GNV © 
t- = ONTeX 
SALLVOEN 'TIVWS Sd3LS ONIMOTI04d ‘HOIH Sd3LS AOOId UaddN ‘SWIL LSUIa 


ONIN + GX = ax 
OI + 1X = 2H 
L + 9141 = O1aI 


agavot x001G wgsaan 
(Q14I ‘IGI ‘doer *xXVWEE ‘ax ‘GN ‘vane ‘dOI ‘HddN1)GOTHAW TIVO 04 


08 OL O9 (0°a9°O1aI) aI 

"IN - ZNON = 41GMaN 

O = &% 

o=er 

L+ar= ac 

40l + if = ee 

t- = GNdXaI (xvWar"do'ar) ar 


dgqvo1 X901a YsKOT 


(UNON “HIGI ‘doe *XvWEr ‘ae ‘AN ‘Vane ‘4OI ‘YaMO1)GOTHAW TIVO 09 
b+ GN = GNON 0S 


o= in 
o= ic 
SIN@W31a ALVONCNOD ONINIVLNOO SUIVd XGNI AOOTG auV aX aNV aC 
L + Lad@Nexva = ax 
| + Lad@Nexve = ac 
Z/ENOTGN = LNOTEN (AVX"OF'AVE) AI 
4 - QNOTGN = ONTEX 
aN = ONIX 
lad@Nn = LNOTEN 
(@-LXaW)**Z = Lagan 
SH01d AIdILINW *AZIS WOO1G NVHL YSLVEYO ‘NAWIG LSuIa ‘mOTaE 


091 OL OD (a*°S1"LXaW) aT 
t- = Oar 


NOISNSWIG LSYId NI LNSOVCGY SEN IVA JO MAGWON SI LXaWe+z 
(L)VXSW = LXaW OF 
aS “NSWIGILINN WO¥d GALNAWOD SAOIGNI ASVa OIMLAWWAS-3LVONCNOD 


0€ OL OD 
t - WIGI = WIaT 


ovo 


vou 


vvuy 


uv vou 


vue 
1.5-23 


vou 


eve 


vou voy 


Chapter 1 


FFT Programs 


SOQNILNOD OF 
OL OL OD ((I)vauvar‘oa'ac) aT 


Z‘L=I ov od 
2 
Gvau INSWYND NI GgSSEOOV 3a OL SINSWA1S 40 WSEWON SHL SI GTHON 9 
2 
L = QTHON (0°L1°LNON) aT 
| - MOTON = GTHON (Z*O3*VauVI) aI 
MOTION = GTHON 0€ 
Z*(1-MOTON) = MOTON (0°SN‘(Z*LNON)GOW) 4I 
NON = MOTON 
O€ OL OD (Z*Oa"vauVI) aT 
0S OL OD (O°LT"aL) aT 
@eGN = GaN Oz 
2 
(QgavVaIS OSTV ‘AATIId AOOTd ONO) LSIT AOI GATIIa ATLUVd SUYVEIO-gud D 
2 
SNNILNOD 01 
t- = (1)vaaer 
aavdN*}=I OL od 
t- = LSIxgI 
0% OL OD (O's9*(t)vauvar) az 
F) 
‘1a@ L- SWIL LSuId) Z YO | VEY NI GgaqVOI X001g 4O XGNI SQIOH ()vauvar 9 
2 
“S/ aavaN '/L-/ (@)vauvar */t-/ (1) vauvar viva 
(S)¥adON ‘(S)¥adec ‘(Z)VaNVON ‘(Z)VEuVEr YZOTINI 
(L)van@ xa1awoo 
2 
“WHIGOUd 4I ‘OLE UVdN SSVSYONI LNG *agqggoxa 4I ava¥-TIV OL 2 
SLINVAIA *NOILVWHOANI SIHL G'IOH 4UVdN 3ZIS dO ()V4dON ‘() Vader SLSIT 2 
“SMOOT ,INGLSIXS-NON, 40 ONIGVEY SHL ONILNSATYd 2 
‘NOISNVAXS ONTUNG SXOOIE AITIId ATV ANV dO NEXVL 38 OL FLON D 
MOTIV O% ‘dVOI SIHL NI GaSS3OOV 3a OL SINSWI1E 40 LNNOD SI LNON 2 
2 
QIsa¥ XO01d 4I ‘SWVS 3d JON AVW) VaNV OL LaSadO Waaana SV 4OI sNUNIaY 
SVaUV NOISNVdXd SN'ld ,waddn, *,YSMO1, ‘V4N NI XIdWD be(Geez) SasN 2 
“XOO1G GEdVOT OL Vand NI LaS4d0 IWOLOV SV GENUNLaY AOI O 
OS ‘Vauv UNSUS4dId NI 3a AVW ‘INGGISSY AGVENIY NOTE AI ‘ina O 
“SV@UV BSSHL NI GaqdVOT ATIVOISAHA ATIVWHON HOOT LVHL SLON O 
ONITEWVYOSNN IVOIDOT NI SVSYV OME JO (HaddN) Z HO (MEMO1) L=VauVI Oo 
‘IVSU/X1dWD L+ ‘XIdWO/TVaH NOILOGUIG 1-=uIGI Oo 
SHOOT ONIGNVdXS OL LasddO 4Ol *NSNVAXS YOd XGNI XOOTH XVW SI XVWEC D 
(4/0 KOIL ‘IWNId S900 |-=8¢) Bf YSGWON XOOTE ‘xIdWD HN AZIS YOOTE 2 
2 
(LNON . 
“ulgI ‘doae ‘xvwar ‘ae ‘aN ‘vana ‘4OI ‘vauvI)dOTYaW aNILNONaNS 
2 
Sattar nna we nies ne seen nanan concer enen shone nnn nape beeeebe seer aseen ewes, 5 
NLNOW ONITEWVYOSNN Lad ‘Ivae Od ‘VANE AVYNY TYOLS BHOD SavOINN ‘savo1 9 
aqoTuaW :aNTLNOWENS D 
2 
2 
ang 
01z OL OD 


(°0*((£)vana) Iwau) xTaWo = (c) vane 


( 


(£)Va08)OVWIV)XTaWD = WaLE Opz 
) 
SWVS Juv SINSWSTS GNV |-=¥vdI aI 3SVO IvIOadS ‘moTaa 2 
2 

01Z OL 09 

(QD vang)9rNoD = wala 
OZ OL OD (X*Oa*L) AI OF 
2 


(GNNGaY LON | YO O=xVdI YO L-=NvaI YSHLIa) AONVGNNGgY ON *MOTaE OD 


01z OL OD 
(co) vane = wala 
O£Z OL OD (O"LT*GNAXSI) dI 0zz 
E) 


ATINGUSAGIG GILVTUL 3G LSAW (0=D4MI) OM HLIM ONITGWWYDS ‘MOTEE D 
2 


06 OL oD 

W3L@ + (W3LV)OCNOD = (x)vane 
(W3Ld)9°NOD - Waiv = (c) vane 

( (Waa) TVae* (WALE)OVWIV)XT4W = WILE 
Me (WOLE-(C)vand) = Wale 
WALa+(C)vand) = WALY 01% 
(QD vana)9cNoD = Wale 
0% OL OD (0°Oa'SaMI) aT 


ooz 
2 
Lad ‘IV3u-OL-X31dWOD YOd ONTIGMVYDS ‘MOTSE O 
F) 


06 OL OD 
((W3LE) TVaa* (WELV) TVaH)XTaW = (C)VaNE 061 
2 


SWYS SUV SLNSW31S ONY L-=XvdI dI 3SVO IvIOgds ‘MOTSa O 
2 

06 OL 09 

(Waa) 92ND = (x) vane 
061 O% OD (M'Oa'L) AT OBL 


2 
(4NVGNNGS% LON O=2%VdI HO |-=NXvdI WSHLIG) NOISNVdXd AVUUY ON ‘MOTaa O 
3) 


06 OL OD 
(WHEE) 9CNOD = (9x) vane 
(WELV)SCNOD = (x) vane 


F) 
(GNVGNNGSY TIELS GNVY O=XVdI YO 1+=XvdI USHLIA) NOISNVAXa AvUUY ‘MOTIa O 
> 
OBL OL OD (O°LI'GNAXSI) aI OLL 
F) 
XILNTUGAGIG AILVEUL JA LSOW (0=D4MI) OM HLIM ONTTEWVYOSND ‘MOTZE O 
Fo) 


09 OL OD 
LOWAN ( Ldd@Ne(1-ax)-AV¥) = LH 
LOWON® ( Ldd@Ne((-a0)-AVe) = LC 
2 
SLNEWATS SLVONCNOD ONINIVLNOD SHIVd XSGNI XOOIG aYV AX GNV ar D 
2 
L + Lad@Nn/ava = ax 
4 + baaanvave = ac 
b + Z/LNON = ZNON (AVM"OS'AVE) AT 
0 = ONTaX 
NON = ONIX 
tGWON = LNON 
taWON/EN = Laden 
txaW**Z = LGWON 091 
2. 
SYOD-NI TIV SHIVd X3GNI ‘S3ZIS XOOIM NVHL SSH1 “NSWId LSuIa ‘moTaa 
2 
SNILNOWGNS WOd NUNLEY D 
° 
nunay 
OQNILNOD ost 


re) 
WHOLS SSVW OL SXDO1d NSLLIYMNO ANV 3LIUM OL GOTYAW OL TIVO AWWNG 3 
2 


(9141 ‘WGI ‘40ar *xvWar ‘WIOT ‘aN ‘Vana ‘4OI ‘VauVI)GOTYaW TIVO 
Z*L=wauvI OSL OG OFL 


1.5-24 


Section 1.5 


(LL)ENI wazOsLNI 

(Lb) TWA Ivae 

SZSN ‘WOUN ‘GUN ‘MEIN ‘WEAN ‘LOUN ‘LGLN ‘(b)VWON /LNIZN/ NOWWOO 
QZIS ‘HOON *ATGY ‘ATL ‘MIed ‘LWON *LWGL ‘(p)YWIG /TWAaW/ NOWKOD 
WdI *XSOI ‘XSaI ‘IvOS ‘IGI ‘NOSI ‘WIGN ‘(¥)VXEW /DYVdN/ NOWNOD 


GONNVS 4I |+=UvdaW ‘SONVA LOTHHOO OL XSI ‘XSI SIOWOd ANINOU ‘SLON 


(XdOI‘XaaI'()VX3W 40 GVSLSNI NSATD ¥ODu* NIEU ()VWIG) 
/WAAW/ WOUA /DUVAW/ NI SLNANOAXE SALNGWOD ASHRARY * |=dWOOT 
/94VaW/ NI NSAID SANIVA WOUd /IVAAW/ NI SENIVA SBLNAKOD *0=dWODI 


LdaW2 SNILNOW *XaTaWOD SI Viva ‘0=4WuI 
“LdaWa INILNOY ‘XaTdWOO SI VivVd {+ ‘Iva GgxOvd SI viva ‘1-=aWal 
‘10adaa ONIMOTIOd SHL SAVH SLNSWNOYVY ANILNOY 


“Ovld SV |- GENUNLaY YvdaW GNV ‘XVWXId A@ ‘OUVI OOL 4I L- LES SI 
GNIGW dO SNIVA ANV ‘/IVAaW/ 40 NOISHSANOD USOTLNI SI /LNIAW/) 
SIVEY /IVAAW/ TIV ‘(IVDS LddOXd) SOLINI BYV /D¥VAW/ TIV LVHL 3LON 


(SUNEWHOD LaaWa 3aS) ()VXBW 40 WIGN OL WAS SI W 3YaHM 
‘WHOASNVEL JO 3ZIS ‘IWLOL SAILOSdaa AHL SI HOIHM ‘W+**7=SZIS=9ZSN 
(STVau XBOI+*Z) YOO ONIMYOM Lad NI SIVaY 4O WON SI ¥ODY*YOUN 


(L 4O O=%vdI ‘ONIGNVdXS NGHM VLVG ‘Ivau GaxOVd HLIM KINO NGLN°LO*AGaN 
*SENIGNOY Lad AG SSADOV GNV BZIS 31d LNEWYND GNV XVW SHAID) 

(SIvau XadI**Z) XOOTE ONINYOM Lad NI SIVaY 4O WON SI WIGU*NaUN 
WIGU'AGUN AZIS 4O SGOT, 4O WON IVLOL LNSYUND SI AIGL'AGLN 
WIGU'AAUN AZIS 4O ,SGOTY, JO 3ZIS AII4 WOWIXVW SI WIHa'NaIN 


SHZIS INGYS4dId dO ,SGOSY, AIGNVH NVO LIWMAW/GVaUAW LYHL ONIWOSSV 
“SIVEY LWGY' GUN ‘LIYM4W/GVau4W AG VLVG ONISSIDOV Od INaasn) 
NOISNAWIG LSYId LNEYYND NI S‘Ivay dO WON SI LWOY*LGYN 

(Wdu' }GYN BZIS dO ,SdDgx, 4O WAN IVLOL LNSYYND SI WAL LGLN 


(WIGN GNOASG "b= GNV ‘OG ‘(L)VXSWe*"t=(L)VWIG=(1)YWGN -9a) 
()¥X3W OL ONIGNOdSSYYOD SAZIS NOISNAWIG GOH (>) ¥WIG* (>) ¥WON 
SS99OV A114 YOd INAISN *SANIVA GILNAWOD NUNLEY /LNIAW/* /1VAdW/NOWWOD 


SSANGLA1dWOO Od GSGNIONI LNG ‘SYaH GEYONOI FUV TvOS*HIGI‘NOSI 
IMWd LddWY AVdI *SNOdXE 3HOO GNV XOOI XSOI'XSGI ‘SNSWIG WON WIGN 
(SSHOXE SOUIZ 1/H) SNOISNSWIG } OL dN YOd SLNANOdXS SGTOH ()VXIW 
GLdaW4 FNILNOWGAS ‘SINIWWOD SV ONINVAW SWVS GAVH SAWVN J IGVIUVA 
$SMOTI0d SV ‘STIVD Lad NI G3SO SV SLNSWNDYY SQIOH /DYV4W/NOWWOD 


(aWOOI ‘aWaI)uvadW NOTLONDA 


HOUMA XFGI 1+ ‘LOTWYOO INIAW TIV LON 4I L- ‘ATIVWHON 0 SNUNLEY Uva 
(MOISd BIS) SVEYV NOWNOD € NI GaLNdWOO GNV G1SH Suv SUaLaWVuva 
SUSLEWVYVd ATI Ladd FYOLS SSVW 3LNAWOD-SSO¥D OL INILNOU Wad ISH 

UvdaW = =NOTLONNG 


CVLVOOOOG VOOUDLODOOVOOOOUOOUUOUOUUUUOUUULVUUUOUUUUU 


VEUVI IVNIOIYO SAHOLVW VENVI LNEWUND dI LNNOD SSHOOV aSVEYONI 
2 
(THON + (I)VEUVON = (I)VaHVON 
OSL OL OD (VauVI'SN'I) 4I 
b + GN*(L-I) = 40r obL 
E) 


GNNOd 3H OL SI AOOId SHAHM VaHV 3HOD 4O LaSadO 3SVA SI 4OI 
GaqVvoOT AGVaWIV XOOTE - ASVO IVIAINL ‘MOTSa D 


2 
SNILNOWGNS Wows NUNLAY 2 
eh 

NUNLaY OL 


ee) 
GayInosu JI OCT ASaNVaXg avay O 

5) 

(ac+aoar ‘gaan ‘(aag0I)vana)avayaW TIVO 0zL 


EI) 
Qvau OL SISIXS LI NSHL ‘G3TIIa Luvd KINO SVM GVaY 3a OL AOOIG AI O 
2 


THON + (I)VadON = (V3UVI)VSHVON 
t- = (I)vaaer Olt 
O£€L OL OD (O°LI'LSIXAI) aT 
SQNI“NOD 001 
OLL OL OD ((I)vadar*Oa'ar) aT 
auvdN' =I 001 oa 


2 
avg OL LSIXE XOOTE SAOd - NOISNVaXa ‘MOTSE D 
2 
OZL O% OD (O'LO"IGI) aT 
O£L OL OD (xvWEr*LO‘ar) aI 
(THON = (VSYVI)VaYVON 
>) 
INN02 SS39OV 3LON GNV AOA GaYINOaY avay D 
> 
(qe ‘agen *(40I)van@)avauaw TIVO 
O£L OL OD (O'“T'EL) AT 
ac = (vauvI)vauvar 06 
F) 
GaTIId Luvd 4I ‘agGNVdxa Gva¥) XGNI XOO1d ONILON XDO1a avau ‘MOTaG D 
5) 
ONIGNVdXS 4I YIVd NOOTE LNO BLIUM ‘ATYVIIWIS DO 
3 
((WaavVI)VauvEr+aogr ‘aaeN ‘(gas01)vand)LIUMdW TIVD 08 
Py 
(WaaVI) VENVON = (I) VvadON 
(vaavI)vauvar = (I)vader 04 
I = GSIxaI 
aavan = 1 
2 
dvgu TIV OL SLINvagsd ‘SLSII NI WOOY ON O 
° 
@QNILNOD 09 
04 OL OD (O°L1"(I)Vaaar) aT 
aavdN‘ =I 09 od 
c) 
GSLON GaSSZ9OV SLW1G ‘XAGNI ‘GETII4-L¥vd KINO ADOTG LSV1 AI ‘MOTSE D 
F) 
08 OL OD (GN*E9'(VauVI)VEYVON) aT 
06 OL OD (XVWHC'LD' (VauVI)VauvEr) aI 
06 OL OD (O°LO*UIGI) aT 
2 
4OO1E MIN ONIGVEY FHOdsa AOIA LNO ALIUM D 
Pr) 
((wauvI)vauver ‘gaan ‘ (401) vane) LIuMaW TIVO 
06 OL OD (O°LT"(vauvI)vauvar) 4T 
GaN + dOI = aqdor 
t+ GN*({-vauvr) = gor 0s 
F) 
GNNOd 38 OL SI NOC SYSHM VaYV ZYOD 40 LaSddO ASVA SI AOI D 
MSN NI GVSY NSHL ‘XOOIE INFGISAY LNO ALIUM ASUIad ‘MOTE ISIMUAHLO D 
Ee 
(OS 4I IVIAIML) FHOD NI AGVSWIV AOOTE GguINOTY 4I BES OL SNOT ISaL O 
2 


1.5-25 


Chapter 1 


FFT Programs 


G4IHS GGYINOIY WUOA OL *SLUVa OML JO IVSUZATE ‘MOTE 2 
2 
OL OL OD (0°LT"LaHSN) aI 
2 
SLI@ XSYI SAOGV SLIG W IVSHSASY-LIG TIVHSAO IVILINI > 
2 
(WoW ‘XS¥I ‘XEOI ‘XgeeI ‘vang)LuosaW TIvD 
2 
USIT XSW SASYZATY GNV IVLOL W SONIA 3 
2 
XdMI + (1-‘WIGN‘VXSW)WOSaW = W 
NUNLTY (0°OF'SN) aI 
(WIGN'LAHSN)GOW = SN 


(L)VxaW waoaLNIT 

(t)vane Iva 
B) 
(SUNAW312 ‘IVaa (XIUI+W)++Z SI AZIS SHOLS SSVW TVLOL aNV > 
“SIVEY XGUI*++2 SI dNO¥D LNAWSAOW ‘SI LVHL) X@TdWOD | ‘IVEY O=xauI > 
SNOISNEWIG 4O YSdNO SHL SESYZATY ‘1-=LaHSN D 
GOW) LAIHS SOVId L4HSN DYID *NOISNSWIG LXEN OL “Sula **DLa Z‘1=LaHSN > 
SYND90 JONVHO YO UaIHS ON ‘O=LaHSN 2 
#SQHL *LNNOD LaIHS NOISNWIG SI LaHSN 
@ GaS) AVWAV SYOLS SSVW dO ZIS SI We*Z SUSHM ‘W=(C)VXW :WIGN OL WOS > 
SNOISNSWId dO HAWN 3HL SOHL CNV LSIT NI SLNSNOdXS 40 YAGHON SI WIGN > 
MId SHTGVIUVA INSOVCaY ‘(2 3SVG) SNOdX3 3ZIS NOISNSWId dO LSI1 (c)VxaW > 
FE) 

(XdOI *Xa@I ‘Vand ‘XSUI ‘LaHSN ‘WIGN ‘VXSW)WHSdWa 3NILNOwENS 
2 
= ewenn name eeaennmn at): 
€-962 “dd ‘92 IIuav *Z°N'EZ*A ‘WOV'L CNV ‘64/8461 - SWOL WOV ‘waSvua) > 
SSANQ1G1dWOD YOd GAGNIONI SI LNG SNLYENS Lad AG G¥SN LON SI SIHL ‘SLON > 
AVEHY BYOLS SSVW XB14WOD YO IVEY JO SNOISNGWIG 40 UxqHO SLaIHS > 
WaadWa = :3NTLNO¥ENS 2 


aaron easeaan =-=-9 


3 


ana 


FE) 
(O=4WUI) L=YVddW YO *L-XBOI"LON'XAEI GNV L+W“LON’XSOI s3ouoa 3 
2 
OF OL OD 
b = Yvdaw (L'LI'xgar) aT 
4 ~ XSOI = XSGI (1-xXaOI'~O*XaaI) aT 
b+ W= X01 (L+W'LO°xXaOI) aI 06 
° 
Nena 
Fo) 
(SOUVT OOL 4I L-) /INIGW/ NI SHAOSINI OL /IVAAW/ NI SANIVA LUZANOD > 
E) 
SOQNILNOD 08 
b- = MVddW (O°OE'UVddW “GNV’ O°07°(I)INI) aT 
(S°O+(1)IWA)XIaI = (I)ENI (XVWXIa‘ST*(I) TVA) aT 
b- = (1)aNT 
bi*L=I 08 OG 04 
2 
/SGOgu, JO YSEWON SV LWGL JLNdWOO aSIMYSHLO 2 
2 


SIvau Way a3ZzIs 
(WoY/ZzIsd = LWaL 
"@*iWad = LWay (0-a9"aWuI) aT 
(L)¥WIG = Lwaw 

b=WIGN 4I GaLa1awOD gor 2 


04 OL OD (1‘Oa"WIGN) ar 
ziIsa = twaw 


“L = twat 09 


wieu/ZIsa = A1GL 
gZIs = ZIsa 


olga ‘OS JON Iva¥ Ggaxovd Hoa LN ‘wW1Ga=NIGL ATIVUENTO 


09 OL OD (0°aO*awUuI) aT 
418d = WIaL 


AIGISsOd ‘ATHY AZIS *,SdQgu, 40 YAEWON WOWIXVW SI wIGa 


(WILT) LVOTa = wIGa 
4 + WELT = WALI (ZISd°L1"S*0+NTaY* (WHLI)LVOT4) aI 
(S*O+NTHY/ZISa)XIAI = WALT 

qdvd + 3ZIS = ZIsd 0g 


X1dWOD N3HM ‘O=XVdI 4O SSVD UVINDILAVd YOd aaLNaNOD cava 
(WIGI)VWIG/*¢*azIs = aava 
4 = WIGI (O'L1'aWuI) aT 
WIGN = WIdI 

NOISNVAXS @1Id ON SaUINOTY 1-=yvaT 


OS OL OD (O°LI'xVaT) ar 
“0 = aava 


‘*aVdI YO LaaW AI ,3ZIS, ‘SIVaN NI 9ZIS 31a IVNOILIGGY SI aava 


OS OL OD (0°LO*AVdI *HO* O'OE*aWYT) aT 
aZIs = aava 


XGOI**"Z = YOOU 
xXddI*e'Z = Tay OF 


(t -/+=4WaI) L=4vddW YO *2-XaOI'LON'XaGI ONY W'LON'XSOI saouog 


| = uvaaw (Z°uT"xaaT) aT 
@ - XaOI = XSGI (Z-XS9I°LO"xaGI) aT 
W = X39I (W°LO*XSOI) ar 
06 OL OD (0’Oa"aWUI) aT 


Wee'z = gzIs 
SNNILNOD Of 
(1)¥xaWee"@ = (I) vAIG 
(1) VxaW + Woe W 
0 = (I)VXEW (WIGN*LO’I) at 
XVAN'L=I 0€ o@ 
O=W oz 


SONILNOD 01 
(s"0+2DIV/((I)VHIG)OOTV)XIaI = (I)VXaW 
WIGN‘L=I 01 od 


(S*0+Z91V/(¥OON) OO1V) XIaI = xgor 
(S*0+291v/(xIGa)D01V)xIaI = XaaI 
(*2)901v = zo1v 

0% OL OD (0°OS"aWODI) aT 

: 0 = avdaw 


((6)HOVWLI)iVOTa = xvWxIa 
/¥/ XYWN Viva 


CCL) WWON' (1)0NT) *((L)¥WIG'(L)TWA) aONaTVAINOg 


evo vou ove 


vo0o 


vou 


1.5-26 


(1-)awNva = (£)vaNva 
BZSN‘L=C OL OG 


2 
NZAIS LON 3SVD NI W 3LNdWOD CNV HOLVHENGD YaaWNN WOGNVH LaSau 3 
3 
(L)anNVa = av 
E (66*WIGN‘VXW)WOSaW = W 
2 
Be NLYGNS Lad JAIVN AG GasN SAZIS FLNdWOD OL 3NILNON Y3d1aH TIVD 3 
> 
2 OLZ OL OD (O°SN"wUaI) aT 
(O*4WHI)uvdaw = waar 
2 
MOISE UVddW NI YOUN ON OS XBDI *XaaI AWWNG D2 
P) 
v = XZOI 
@ = xgar 
2 
QguISHd dI ‘LSIT VXaW-GExXIa XB dOO1 OG ZOvVIdsy 
2 
€W = (€)¥xXaW 
ZW = (2)¥XaW 
€W - 2W - W = (4)VXSW (€°OS'WIGN) aI 
@W - W = (L)VXSW (Z'O9‘WIGN) aI 
Wo= (L)¥XW (L°O"WIGN) aT 
Wen L=EW 081 OG 
| = WeW (€°SN"WIGN) ar 
t+ @W - W2W = WE 
WZW'L=ZW 061 Od 
= WeW (L°OR"WIGN) aT 
t+ WIGN - W = WeW 
LWIGN = WIGN 
€*L=LWIGN 002 oa 
2 
SNOISNGWIG € GNV Z‘| HOd VXEW B1aISsod T1v aLNaWoD ‘moTgE 3 
2 
“0 = OWdaId 
(/(USHL LaaWe=t-HpL 
‘*USai bdaWO=0) HSL ‘EI ‘= GWT  H6/(VIVHRAO=|-*Sadld XvW=HZZ 
‘o*smordoo=1) HEL ‘eI ‘= GNIUdI HE/LSTL Lad JYOLS SSVWLHOZ) LYWHO 6666 
AWHI “NTMI (6666'dT) SLIM (O'S T"LNIWGI) aT 
5) 
LNdLNO LSaL YOd SONIGVAH INIWd ‘MOTE 3 
2 
TINSTY GazsanoOS OL aNd SAUNIIVA LNAYVddY SATO |- ‘(L4aWH) 0 HO L=xVaT D 
(G4aW) 0 YO L=¥IGT ‘(GdaWu) 1-=¥IGI ‘| -/+=NOSI “SouY Lad 3 
By 
\ = xvar 
t- = uIar 
t- = NOSI 
2 
GSGL LddWD ANILNOW XATdWOD 0 ‘LSEL LadWo AINILNOU TVau |-=4WHI OD 
2 
t- = dwar 
2 
(dOOT Od MOISE SINAWWOD AIS) ASSN 3a NVD SEN IVA agxIa 3 
ONIdd3LS WIGN*VXEW‘XAOI'XSAI OLNY YOd 3ZIS AVEYY TIVHSAO SHL SLES WD 
2 
Va} s=W 
- ro 
e AINO SONSURGSIG XVW TIVUTAO L- ‘KINO SSONIUZAdIC XVW YO O=LNIAI D 
o “ENIYd SMOIdOD WOd L+=LNIWdI ‘LINN TVDIOO1 UALNIWd SI dT 2 
3 
3 L = LNTYaI 


(Z)HOWWLI = a7 


3 
ISGL NI G3so yivd WOGNVY Oanasd sqIOH vaNvy 3 
WvuD0ud GNY Lda HOA SHOLS 3YOD NI VaUV ONIXYOM SI (vango=()vana 2 
NOSINVdWOD YO4 Lad SAIVN 40 LINSTY GIOH ()AIVNE ‘()AIVNY 3 
OLS SSVH SLVINWIS OL LIMMAW/GVSYaW SANILNOY AB GESN ()SYWY/SSVW/NOWWOD‘D 
2 
((L)vana@*(L)vango) goNaTvAToog 
(pz0L)vang *(pz0L)VaNVY IvaH 
aId> ‘(Zis)vanad *(ZiS)AIVNE '(Z1S)AIWNV xaTaWOo 
(Ze) 4x NOTSNaWIa 
(201)SVWH /SSVW/ NOWWOO 
ss) 
“YvdaW SNILNOY ‘SINWHOD gas OD 
/WAGA/ WOUd /DAVAN/ SWOS ILNdWOO-aSYIATY NVO HO O 
($804 4I SLNSIVAINOT YAOTLNI) /INIAW/ ‘(3ONVI 3WOS SV SVEN) /IVAAW/ 2 
OLNI /O¥VdW/ WOUd SANTVA SBLNAWOD UVddW ANILNOU waaITH 2 
SINANOdXa ATLSOW *SATIVO Idd NI GaSN SLNEWNDYY SQIOH /D'UVaW/ 
dd 3YOLS SSVW ONINNOY YOd INasSN /LNIAW/‘/IVAaH/*/DYVaW/ SVIYV NOWWOD 2 


2 
SZSN ‘NOUN ‘XEUN “MEIN ‘AGEN ‘LGUN ‘LGLN ‘(>)VWON /LNTSW/ NOWWOD 
SZIS “YOON ‘HIGY ‘A TGL ‘AIGd ‘LWON ‘LWaL ‘(%)VWId /TvAaW/ NOWWOD 
MVdI ‘XSOI ‘XEGI “IVOS ‘YIGI ‘NOSI ‘WIGN ‘(%)VXEW /O¥VAW/ NOWWOO 

2 


“vdN@ AVHYVY YOd (XFTAWOD YO IVEN) TdAL LNUFAdIA 9 

aS TIIM SANILNOMGNS INSYS44Id ‘Lad SIHL NI ‘VaN@ AVYYV ONINIOM O 
NVELYOd NI GNV SYOLS SSVW NI HLOG ‘SINSWS1S ***OVWI/IVEY/OVWI/IVay 3 
ONILYNUSLIV SV JSIXS LSOW VLVG X@1dWOD 3dAL LVHL TT3M 3LON 9 


440-GNNOY SNIHOWW dO HSCHO HVEN ZUV SONTUSaAIG XVW AI NO LSaL o 
(SLN3WWOD 33S) SSONTHSAaIG XVW KINO YO *SNOIdOO aa AVW ONILNIYd 
(SANILNOWNS O/I AWWNG 33S) SAVHUV NVYLWOd AG GSLVINWIS SI aYOLS SSVW 
(SINSWNOD 33S) T1IM LY GaUaLIV 3d AVW SYBLEWVUVa Lda O 

dd GAIVN HLIM NOSIMVdWOD AG Ldd BYOLS SSVW BHL SISAL WVYOOUd SIHL 3 
‘IVSUJAIND §‘WvuDOud LsaL O 


ana 
Nuotay 
SONILNOD 02 
(W ‘HI ‘OI ‘XSOI ‘xSaI ‘vana)~uosaw TIvo 
(f)vxaW + HI = HI 
HI = OT 
WIGN*L=c 0% oa 
xaUI = HI OL 


=) 
(IvSuaag¥ NEWIG) NOISNSWIG HOVE YSAO ASUSATA ATALVUVaES ‘MOTaE 3 
) 
SLA4IHS OITOAD WILY ANILNOWENS WOYA NUNLAY 3 
e) 
Nungae 
r) 
GSI VxXaW dO Juvd Yaddn asuaAgY O 
2 
(L-"SN-WIGN* (1+LaHSN)VX3W)WOS4W = HI 
2 
SLI@ AVHYY 4O Luvd WaddN ASuaATA ATaLVUvaES O 
By 
(W ‘W ‘HI ‘xXgOI *xa@I ‘van@)LuosaW T1vo 
F) 
SLI@ AVHYY 4O LUVd YEMOT GNVY LSIT VXIN 40 LYVd WaMO1 aSUaAgU D 
2 
(W “HI “XUI “XSI ‘XSGI ‘vand)LuOsaW TIVO 
Xgl + (1-'SN'VXEW)WOSaW = HI 
P) 


1.5-27 


Chapter 1 


“(Z)vaNO *XEQNI (9666'd1) ALIUM (O°SN*YIGI) ar 
OLL OL OD (O°S1°LNIMAI) aT 
aid = Wald (WaId"L9"4Iq) ar 
((aId>)9vWIv)Sav = 41a 
ald = Wald (WaIq"L9"4Iq) aI 
((aId3)1vau)sav = ara 
(£)AIVNY - (I)VaN@O = aTGD (0°OR"HIGI) aI 
)vaN@ = 4IGD (0°SN"HIGI) ar 
t - ¢ = XdqNT 
rI+vec 
GNON*L=I OLL o@ 


a 
(SaaH AGAIN ONY AGLN JSON LSOW SSIMUSHLO ‘HONS INYagaIa 40 2 
sSQUOOTU, LAFIOV OL ATV AG OL LIMMAW/AVAYAN SAUINOGU SIHL *SLON) 9 
(vdaW A@ JAOGY GALNaWOOT4) HLONTT NWI LSYIa 40 ,Sazu, avay 2 
F) 
(ac *LGNN ‘van@)ava¥aW TIVO 
GNON*(1-8L) = % 
IGEN‘ t=ac 0Zt OG 
‘Oo = WaIG 
2 
“INSTA SAIVN HLIM LINSIY XITaWOD Lad SHYVaWOD ‘MOTEE 2 
2 
(SIW1d LNON *SLVIS XaT4WOD NI VLVd WOd {+=aW4I LON) 9 
NOISNAWIG LSUId NI STVEY LGYN dO EWAN IVLOL LGLN *NLNO¥ ¥adTSH O 
2 
Z/LGUN = LNON 
OLZ OL OD (O°SN"UNSI) aT 
(O‘aWaI-)¥vaaW = wusI ob 
2 
(aaraHy * 
‘X@L “SAIVNHS ‘X6L ‘LdaHe ‘X6 ‘XHGNI HB) LYWHOd L666 
(4666°a1) 3LTaM 
(sT€ *= ()WXSW HOL/ET ° 
‘= MVdI H@ ‘€I ‘= XdOI HB ‘EI ‘= XdaI HB . 
‘eI ‘= MIGI H@ ‘€I ‘= NOSI HB ‘EI ‘= WIGN HB) LYNNOd 8666 
(WIGN* L=L* (¢) VxaW) . 
‘MVdI ‘XSOI ‘XI ‘MIGI ‘NOSI ‘WIGN (8666'd‘1) ZLIUM 
AWAI ‘INTHaI (6666'd1) 3LTuM 
Fo) 
LNdLNO LSaL YOd SONIGVEH LNIUd ‘MOTaEa 
2 
001 OL OD (O°ST"ENIWAI) aT 06 
5) 
WINSA XATEWOD OL AVHAV WHOASNVYL OL LadWD ANILNOU FYOLS SSVW XBTEWOD D 
2 
(xa . 
‘XHGI ‘vaN@ “IVOS ‘YIGI ‘NOSI ‘WIGN ‘WX@W)LaaWo TIVO 
2 
(3uaH AYN GNV AGLN JSN LSOW ASIMUSHLO ‘HLONET INFYSaaIa 40 2 
+SCHOOTU, LdG90v OL AIAV AG OL LIUMAW/GVANAW SANINOTY SIHL ‘SLON) 9 
HLONGT NAWIG LSYIa dO ,SdOTH, NI AVHMY XT4WD NI SENIVA Ivgu avo1 O 
a 
SONILNOD os 
(a@c¢ ‘LauN ‘vang)LIuMaW TIVO 
SONILNOD oL 
(0*(£)vaNva)xTaWwo = (1)vanED 
Te ae 
ANON‘ L=I 04 Od 
INON* (1-82) = 4 
Lan‘ L=ar 08 od 
Z/%NON = LNON 09 
2 
Id USuId NI SLWId X1dWO JO WON ZNON ‘LdaWD SNILNOY XATaWOD 3SN ‘MOTaa 2 
2 


06 OL OD 
LINSTY XFTAWOD OL AVHXV WHOASNVUL OL LaaWY ANILNOU TUOLS SSVW IVaU 


(ival ‘xaoT . 
‘XaGI ‘vaNd ‘IvOS ‘HIGI ‘NOSI ‘WIGN ‘VX3W)LaaWu TIVO 


(3aaH NAN GNY YEIN GSO SOW ASIMYSHLO SHLONTI INTUGddIG 40 
,SQHOOSH, LAFIOV OL ATV 3G OL LIUMAW/GVSYAW STUINOTY SIHL ‘3LON) 
HLONST NSWId LSuIa dO ,SGOSY, NI AVYYV IVEY NI SYAWON WOGNVY avoT 
SQNILNOO os 
(af *LGYN ‘vaNe)LIMaW TIVO 

SQNILNOD or 

(£)vanva = (1)vang 

I+*uee 


ANON‘ L=I_0% OG 
MNON® (1-8) = % 
LGLN'L=ar 0S Od 


MOTSE LdaW4 IVaH ‘OS LY LaaWO SNILNOU X¥1dWOD YOd HOLIMS 


09 OL OD (0°OS"aWHI) AT 
“L = Ivos 


(NOISNSWIG LSUId NI SLWIS ‘Ivax JO USEWON SI LNON) 
NOISNSWIG JSUId NI SIVEY LGYN dO GWON IVLOL LGN ‘NLNOY Usd IaH 


LUN = LNON 
OlZ OL OD (O°SN*MNSI) aT 
(O‘aWHI)UvddW = ual 
Ogu 4I XSOI'XSGI GaXId AG SAOOT OG BOVIdSY !agLNaWOO XBOI GNV XaEI 
(xg@I = xaer 
WXAGI'IX9GI=1XEGI 091 Od 
| - XSOI = WXSGI (0°Oa"aWHI) aI 
@ - XdOI = wxaer 
LxXgOI = XgOr 
WXSOI'IXSOI=1XSOI 041 0 
OL OL OD (WXBOI"LO'IXEOI) 4 of 


L + W = Wxaor 
@ = Ixgo1 
L = Ixger oz 
(0°OS"4WHI) MOISE LadWO HO4 XSOI *XAMI WOd SLIWIT INGUSadIa sigs 
0€ OL 09 
W = WXSOI 
py = IxXgor 
@ = Ixaar 
LdaWa ONITIVD NSHM *X3OI ‘XSI ONIddgLs wOd SIWIT Las ‘MoTaa 
0% OL OD (0°Oa"aWHI) AI 
WHO4SNVEL USIUNOA ,MOTS, BLNAWOD OL GATIV ANILNOUGNS La SAIVN 
(N9ST “(€)VWGN *(Z)VWON ‘(L)VWGN ‘AIVNG ‘AIVNV)SAIVN TIVO 
SNILNOWENS SAIVN WOd GNY Lad HOd SHSEWNN WOGNVY avo 


SOQNILNOO OL 
("0' (2) VaNva)xIaWo = (C)AIVNY 


yuo 


evv0K 


vue 


vou 


vou 


1.5-28 


vue 


vue ovo 


vou 


MSFFT 


Section 1.5 


SAIVN 


taNILoo¥sNS 2 


ang 
NunLae 
f£ = aWNva 
f=X 0% 
2 
nuniay 
Z = aWNvea 
dOWT4/ (A)LVOTA = Z 
@OQNILNOD Ot 
(OINGOW*H*S)GOW = % 
St*t=I OL od 
o°8v0z = GOWTa 
gpoz = O1NGOW 
=) 


KYIVWHON Gas a LSAW Cf SATLVOEN 9 
YA IIGINI dO’ LaSIX SASNVD C BAILISOd D 
2 

0Z OL OD (O°sD"L) aI 

(£)aWNVY NOTLONDA 


(yr ‘waar ‘Ho . 
‘LOTUYOD /LNIAW/ TV LON HpZ ‘HO TIVWS COL GEOUOd XSGI HSZ) LVHHOS 


2666 
Waa (Z666'd1) ALIUM O17 
2 
a0Ls 
(vI ‘= xvar HB . 
‘pre ‘= (-/+)MIGI‘NOSI H6L/EI ‘= W YOd VXAW*XSOI'XSGI*HET * 
“(WIG € OL L)VXEW TIV HOd HSZ/P'LLa * ddI XVW TIVHRAO HBL) LVWYOd £666 
MvdI ‘MIGI ‘NOSI ‘W ‘OW4IG (€666'd1) BLUM 


F) 
SONTUTAdIG WOWIXYW TIVHGAO INIUd ‘MOTSE D 
E) 

SOQNILNOD 002 

SQNILNOD 061 


SQNILNOO ost 

SOQNILNOO oLt 

SONILNOOD oot 
2 
WHOASNVUL GUVMYOd HOd HIGI GNV NOSI SYOLSaY 9 
2 


uIgI- = uIdr 
NOSI- = NOST 
Waid = OWdIG (OWdIG*LO*’WdIG) dT 
(WIGN' L=C°(£)VXEW) ‘AVdI ‘XSI ‘xaaI ‘YIGT * 
“NOSI ‘WIGN ‘WdId (S666‘d1) GLIYM (O°SO"INIUdI) 4T 


3. 
(43S WOCNVY IVILINI SV GWVS Za GINOHS) SLINSTU SSHAANI LNIYA 9 
2 

SQNILNOO ost 

SONILNOO ore 


aid ‘(£)vaNva . 
‘Wu ‘XHQNI (9666'dT) S3LIUM (O°LO“LNTYdI) AT 
aid = Wald (Walq'LO"aId) at 
((2)VaNva-wi) Sav = aIa 
((1)vanao) waa = WHY (0°OR'aWHI) aI 


(1)vane = wa (0°SN‘aWaI) aI 

t - © = xaqNr 

I+m=e 

INON‘L=I OFL OG 

2 
(3USH AMUN GNY YGLIN ASN LSOW ASIMYSHLO ‘HLONG' LNUSdaId JO 9 
»SQWOOTU, LAIOOV OL AIAV 3a OL LIUMAW/GVaNAW SAYINOTY SIHL *HLON) 9 
(4vaaW A@ JAOSY GALNdWOITH) HLONAT NAWIG ISuIa 4O ,SdOau, avay o 


2 
(ae *LGuN ‘vand)dvauaW TIVO 
INON*(1-8£) = % 
IGLN' =a Ost Od 
"0 = waIG 
3 
LOANI WOGNVY ‘IVILINI HLIM LINSSY ASUBANI Jaa STXVaWOD *MOTEE O 
ro) 


(X1aW YO IVTX “NOISNSWIG ISUId NI SLW1d 4O WSEWNN SI LNON) 3 
NOISNSWIG LSUId NI STVaY LGYN dO GWON TVLOL LGLN ‘NLNOY Usd IaH O 


2 
Z/UNON = LNON (0°OR"4WHI) aT 
LUN = LNON 
O12 OL OD (O°SN'HUSI) JT 
(0*aWaI)YvdaW = WAaT ofl 
2 
(aarany . 
‘XL “LOANIHS ‘Xb ‘We*Z/LadHe ‘XZ ‘XSGNI He) LVWYOd 666 
(¥666'd1) ALTIUM 
(WIGN* b=£* (0) ¥XaW) * 
‘wvaI ‘XSOI ‘XS@I ‘MIGI ‘NOSI ‘WIGN (8666'd71) 3LINM 
aWHI ‘LNIdI (6666'd1) SLTUM 
2 
LNdLNO LSAL YOd SONIGVSH INI¥a ‘MOTaE D 
2 
O€L OL OD (O’HI"LNIUdI) aT 
2 
AVEUY SWHOASNVYL ASHSANI LW ANI“NOU YO O 
5) 
(xao1 ‘xgaI ‘vane . 
“qvOS ‘MIGI ‘NOSI ‘WIGN “VXSW)LdaWO TIvD (0°O3"aWUI) aT 
2 
‘IWWaY GEXOVd OL AVHUY SHUOASNVYL FSUTANI LaaWa INIGNOY YAHLIA 9 
2 
(aval ‘x01 ‘xgeI ‘vane * 
‘avoS ‘MIGI ‘NOSI ‘WIGN ‘VX3W)LdaW4 TIVO (0°SN‘aWaI) dT 
gZzISs/*l = ‘IvoS 
uIaI- = ur 
NOSI- = NOSI 
2 
(Tva¥-OL-Xa1dWOD) WHOASNVUL ASHAANI WOd BIGI GNV NOSI JUSANI ‘MOTaE O 
E) 
Wald = OWaIG (OWAIG"LO"WAIG) AT 
(ST€ ‘= ()WXEW HOL/EI ‘= AVdI HB . 
‘eI ‘= X3OI He ‘EI ‘= XSGI He ‘EI ‘= BIGI He ‘EI * 
‘= NDSI HB ‘EI ‘= WIGN H8/P°LLa ‘ 4aId XVH HOL) LvWuos S666 
(WIGN‘L=C°(£)VXaW) ‘XvdT ‘XSOT ‘XaaI ‘UIGT * 
*NOSI “WIGN ‘W4IG (S666'd1) BLINM (0'SD"INIdI) aT 
2 
SHONTUSAIG ALVIGAWUSLNI INT¥d ‘MOISE O 
=] 
SONTINOD ozt 
SQNILNOD OLL 
(Zz oLaz*xE‘(E"Lbae *XL)z “ST XL) LwwYOT 9666 
aiq2 *(£)ATYNY . 
“(Z)vanad ‘XSGNI (9666'41) BLIUM (0°OS"UIGI) AT 
aIgo *(£)AIvNE . 


1,5-29 


XINO SHONSUTIAIG XVW 0 ‘SNOIdOD L+=LNIUdI ‘LINN IVDISOI YSINIUd SI dT 3 
2 
0 = INT¥ar 
S = dT 
3 
— O/I 3HOLS SSVW YSGAD YOU LINN TVOINOT SI NAT 2 
a 
5 L = not 
a 2 
& WVUOOUd ANY Lad YO FHOLS FYOO NI VEUV ONTMYOM SI () VaNed=()vaNE D 
rs 
((b)vang*(L)vang>) JONaTVAINOS 
(26L8)vana Ivau 
(960%) vana> xaTaWOD 
2 
“YVddW SNILNO¥ *SLNAHWHOD agS OD 
/WhaW/ WO%a /D8VAW/ BWOS FLNdWOO-FSUTATY NVD YO 
(S$SOd dI SINSIVAINOS YSOGINI) /INIAW/ ‘(3OUVI SWOS SV SIVau) /IVAaW/ D 
OINI /O¥VaW/ WO SANIVA SHLN4WOD UvddW ANILNOU YadTaH 9 
SUNSNOdXS ATLSOW ‘SATIVO ddd NI GESN SLNZWNDUV SCTOH /O¥VaW/ O 
dd JHOLS SSVW ONINNOY YO 1N4AISN /LNIAW/*/TVAAW/*/DYVAW/ SVZYV NOWWOD 2 
2 
AZSN ‘YOUN ‘MEYN 'AGLN ‘NGAN *LGUN ‘LGLN * (>) YWON /LNIGH/ NOWHOD 
BZIS ‘OOM ‘NIGU ‘NIL ‘XTad ‘WON *LWGL *(%)VWIG /TVAaW/ NOHHOD 
MVdI ‘XSI ‘XSGI ‘IVS ‘HIGI ‘NOSI ‘WIGN ‘(%)VXEW /9UVAH/ NOWHOD 
2 
0/1 GYOLS SSVW YAGKO YOd SAOIGNI GUODTY SGIOH XGNIW AVUuY 9 
O/T S¥OLS SSVW HO4 USAWON LINN IVDIDO1 SGIOH /WODLA4/ NOWHOD 9 
5) 
(ZLS)XGNIW ‘NOT /WODLdd/ NORWOD 
° 
2 
*van@ AVYAY Od (XaTAWOD HO IVEY) AdAL LNSUSaaIa OD 
LaS TIIM SANILNOWENS INSYAIAIG ‘ddd SIHL NI ‘vaN@ AVHYV ONTNYOM D 
NVULYOd NI GNV YOLS SSVW NI HLO@ *SENSWHIG ***OVWI/IVaY/DVNI/I¥au Oo 
ONILVNUSLIV SV LSIXS LSNW VLVG XB IdWOD 3dAL LVHL TISM 3LON 3 
2 
(LNdiNO=SaaVvu' LNANI=09FdVL*LOALNO'LOANI* |SaVL)HOLSVA KVEOOU 
2 
=) 
Lad 0/1 SHOLS SSVW YAO GNV 0009 VEVG TO¥LNOD 2 
WOLSVWH :WVHOOUd LSaL 2 
--2=- == ) 
2 
ang 
nani 
SQNILNOD OL 
(1) vang = (4) svwa 
I+ 40l=% 
GN‘L=I 01 od 
@Ne(1-ar) = aor 
2 
(aN) vang ‘IvaH 
(Z0L)SYWY /SSYW/ NOWWOD 
(ae ‘aN ‘van@)LIaMaW SNILAOMENS 
AVaYY FYOLS SSVW SALVINWIS SYWY AVHYY NOWWOD 2 
SNTVA ‘IVau GN ‘SYOLS SSVW OL Vand WHOd ‘Gf X3GNI “XOO1G ALIUM D 
°o GLIUM FYOLS SSYW SS320V WOGNVY ZLVINWIS OL 3NILNOwsNS AWWNG D 
a LINMAW ?3NILNOWENS 2 
Pere tee pee See ore ee k > 
2 
Ng 
NUNLaa 


@ONIINOD OL 
(4) svwa = (1) vane 
I+ 40I = x 
@N'L=I 01 oa 
QN*(1-ae) = gor 


(aN) vane ‘Ivau 

(¥Z0L) SVE /SSVW/ NOWWOD 

(ae ‘aN ‘vaNa)qvauaw SNILNowns 
2 


AVUY FYOLS SSWH SZLVINWIS SVWY AVYYY NOWWOD 2 
SAN IVA Ivs3¥ GN ‘VaNE OL BHOLS SSVW WOUd ‘AC XSGNI ‘NOTE avaY O 
Qva¥ SYOLS SSVW SS3D0V WOGNVA ZLVIOWIS OL SNILNOWENS AMWNG D 


ava¥aw :aNILnOwgNs 9 
_ SP STE SBS ETS 
2 
ana 
NuoLae 
SONIGNOD 06 
SONILNOD 08. 
SONILNOD 04 
(Vo*WX'VI)AIYNG = (VT'Va'¥C)ATYNY 
IN‘ L=V1 OL OG 
YN' L=VX 08 OG 
fN*L=ve 06 OG 
° 
BQNILNOD 09 
SONILNOD 0 
SQNILNOS ov 
aW3L = (a¢*ax'a)AIVNG 
ES) 
SONTLNOO oe 
SQNILNOO 4 
SQNILNOO OL 
(((wivewavevey) . 
*@Id**0)X1aW)dX3D*(VI'VA'VE)AIVNY + dWaL = dWaL 
@ive(l-v1)ivo1d = viv 
‘IN*L=V1 OL Od 
@AVe(1-WX)LVOTE = wav 
XN‘ L=VX OZ Od 
acve(t-ve)Lvold = vev 
CN‘ L=Vve 0£ oa 
(0*'0) = awa 
2 
(IN) &vo14/(1-@1)ivo1d = gI¥ 
IN‘ t=@7 OP od 
QIN) tVOTa/(1-@X)LvOTa = av 
XN'L=a% 0S Od 
(£N)%VO1a/(1-a2)LVOTd = ary 
CN‘ L=ar 09 od 
E) 
@Id- = Zid (O'LI'NDST) aT 
O°@sId = Zid 
(0d0"L)NVZVa + odo" = Ia 
P] 
(ON*XN“IN)AIVNG *(IN‘XN‘CN)AIVNY ‘dWEL XaTaWOD 
(NOSI “IN ‘XN ‘CN ‘AIVNG ‘AIVNV)SAIVN 3NILQOuGNS 
5) 
peda oe 


4aTUNO 4O INENOdXS XA1dWOD 40 NOIS NOSI ‘ONINOISNAWIG ‘IN‘YN'CN OD 
UEGYO GASHZATY AIVNG *HACHO IVILINI NI SNOISNAWIG AIVNY 2 

AIVNG GNV AIVNVY SAVHYV HLOd NI GaNUNLaY Linsay 9 

(IN*XN‘CN)AIVNY AVHHV LNdNI ‘Lad SHOLS SSVW LSAL OL aasn 2 
SNOISNSWIG € OL | - WHOASNVHL HAINNO’ TLAYOSIG AIWN 9 


1.5-30 


(ivaI *xa01 *xaaI . 
‘vaN@ ‘IVOS ‘UIGI ‘NOSI ‘WIGN ‘VX3W)L4aW4 TIVD (0°SN"4WI) aT 
SZIS/"} = Ivos 
uIgI- = uiar 

NOSI- = NOSI 06 

2 

(IVda-OL-XaTdHOD) WHOASNVEL ASUZANI WOd YIGI GNV NOSI LUBANI ‘mOTgZa O 

2 


SOQNILNOD 08 
SQNILNOD oe 
(prELaZ *XZ "ST *XL) Lwwuoa 9666 
(1)vaN@ *XZQNI (9666'd1) 3LTUM 
04 OL OD (O°S14NTHdI) aT 
t - £ = XgqNT 
INON*L=I 04 OG 


MSFFT 


(@WaH LGUN JO ,SGOa¥, IGEN 3SQ GINOD 3SIMMSHLO ‘HLONAI INSUgaaIa 40 
S$Q094, Ld¥99V LONNVO (SWLINM/SWOVGY ONISN) LIYMAW/GVEYAN YIGAD *SLON) 
(Avda AG GALNdWOOTA) AGLN ONTIVLOL *HLONT AGUN 4O ,SGDsu, avay 


evcuvo 


(ae ‘NGYN ‘vane )avawan TIVO 
ENON*(4-8C) = x 
MGIN' L=8r 08 Od 


4I ‘NOSIYVAWOD WHOd GNV) LINSSY XATdWOD Lda SSBOV NVO WYYOOUd ‘MOISE 


(SLW1a LNON ‘SLVIS Xa TdWOD NI VLVd YOd | +=4WUI LON) 
OO Lad NI SIVA AAYN 4O BWON IVLOL AGLN 'NLOOU Yad Tah 


voouvl” 


Z/x@uN = LNON 
O€L OL OD (O°SN"MUaI) aT 
(o*aWaI-)uvaan = waar 
2 
(aaaHe ‘XZL ‘XSGNT HB) LYWYOS L666 
(£666°d1) 3L1uM 
“= WVdI H@ ‘€I ‘= XSOI He ‘EI ‘=HL ° 
‘= UIGI He ‘€I ‘= NOSI HS ‘EI ‘= WIGN H@) LVWHOd 8666 
(WIGN* L=c* (©) ¥XaW) . 
“NOSI ‘WIGN (8666‘d1) GLINM 
aWSI ‘INTYAI (6666'a1) SLUM 


(SIE ‘= ()VXSW HOL ‘ET 
“ xgar HL ‘er 


‘WvdI ‘XSOI ‘xaaI ‘urar 


LNdLNO SAL YOd SONIGVEH INIYd ‘MOTaE 
06 OL O9 (O°ST"LNINdI) 4I 09 


GDINSIA XATAWOD OL AVYUV WHOASNYYL OL LaaWO ANILNOU 3YOLS SSYW XZ1TEWOD 


vuo ovo 


(XHOI “XSGI ‘vane ‘IVS ‘MIGI ‘NOSI ‘WIGN ‘VXEW)LagWD TIVO 


(3HaH [GUN dO ,SGOgu, LOIN 3S GINOD ASIMUSHLO 'HLONA LNaYsdaIG 40 
Sd0au, LdFOOV LONNVO (SWLIM/SWGVY ONISON) LIMMAW/CVaYAN UZGAD ‘FLON) 
HLONGT XGYN JO .SGOaY, NI AVYYY XBTdWOD NI NOILONNA aWv¥ avoT 


vouve 


SONILNOD 0S 
(af *HEUN ‘VaNE)LIuMaW TIVD 
SQNILNOD oF 
ONIA + MIVA = O1VA 
("O'N1vA)xTawO = (I)vanEo 
ENON* (=I OF Od 
GIN t=al 0S Od 
@/GNON = LNON 0€ 
co) 
“LdaWO SNILNOW XaTaWOD 3s ‘MOTES 3 
Fe) 


SOTd Lda NI SLW13 X1dWO 40 WON LNON 


Section 1.5 


09 OL 09 
LINSTY XZIGWOD OL AVHHV WHOASNVUL OL LaaW4 ANILNOU AYOLS SSVW IVay 


(QivdI ‘X3OI ‘XSI ‘vane ‘1vOs ‘UIGI ‘NOSI ‘WIGN ‘VxX3W)LaaWy TIVO 


(JaaH GUN 4O ,SGD3Y, LGIN BSN GINOD SSIMUSHLO !HLONTT LNaYadaIa ao 
Sd9g4, LdgOv LONNVD (SWLIUM/SWOV3Y ONISN) LIYMAW/GVaYAW WABAO *FLON) 
HLONGT AGN dO ,SGOSY, NI AVYYV IVEY NI NOILONNA dWvY avo7 


vovvye vuoo 


SOQNILNOD 0% 
(ao ‘NGUN ‘vaNe)LIUMaW TIV. 
SQNIZNOO oL 
ONTA + MIVA = OIVA 
O1vA = (I)vane 
ENON*L=I 01 OG 
AGIN' L=ae 0% od 


MOISE LddWu IVEY ‘0S LY La4WO SNILNOY XATAWOD YOd HOLIMS 


vou 


O€ OL OD (0°OR’aWHI) JI 
@ZIS/"L = ONIA 

"O = OVA 

"L = Ivos 
(66‘WIGN*VXaW)WOSAW = W 


SXOO1E IVLOL AGIN *XOOTE Lda NI SIW1 JO WON LNON ‘SNI“NOY Wad ISH 


vou 


MGYN = LNON 


(3ZIS S1Id WOWIXVW SV GAN SNUNLEY UvdaW NLNOU Aad IaH FLON) 
}+HG4N=1+,09% WON, HLIM GANadO FHOLS SSVW ,SWLIMM/SWaVau, YaaAd 


vooe 


(0 *L+a@aN ‘XGNIW ‘NON1)SWNadO ‘TIVO 
O€L OL OD (O'SN'UUSI) aT 
(O'dWHI)uvdaW = YuaI 


SIV@U XIOI+*% VANd ‘SIVAN XBMI**z SHOOTA FYOLS SSWW Ladd 
“NEWIG Z ‘SLWIS 9**Z dO SMOU Be*z ‘SONY Lad THOW 


vove 


€l = xdOr 
6 = xaar 
@ = WIGN 
(2) vxaw 
(L)vxaw 


"0 = SWaIG 
(/ (USHE . 
‘HL LadWu=|'LSaL LaaWo=0) Hot ‘EI ‘= aWHI He ‘*(SdaIG XVWHLL 
“s0*SMOId0O=1) HPL “EI “= LNINdI - ISAL Ldd FYOLS SSVWLHLE) LYWYOd 6666 
AWHI *ENIYdI (6666'd1) SLIUM (O°aT'INIUdI) at 


2 
Idi LS8L YOd SONTGVEH INIYd ‘MOTEE O 
2 
(LaaWO) ASSN LON ‘(GdaWa) L- 40 0 ‘L=xVaI 
(@aaW9) 0 HO L=4IGI *(LadWu) L-=¥IGI ‘| -/+=NOSI ‘SouV ddd 9 
2 
b= wvar 
t- = II 
\- = NOST 
2 
USEL LdaWd ANILNOU XZTAWOD O ‘ISAL LadWX ANILNOY IVae |-=aW¥I 9 
E) 
L- = gwar 
eo) 


15-31 


Chapter 1 


2 
Wvu90Ud GNV dd YOd THOLS HOO NI Wav ONINYOM ST ()vango=()vana 2 
2 


((L)vang*(L)van@>) SONaTvAINOS 
(2618) vane Tva¥ 
(960) vane xaTaWOo 
3 
“WvdaW FNILNOY ‘SLNSWWOD 33S 2 
/TWAAW/ WOUd /DAVAK/ BWOS JLNAWOO-3SUSATY NVO YO D 
(S$SOd 4I SLNJIVAINOT USOALNI) /LNIGW/ ‘(3OUVI SWOS SV STVSU) /TVAaW/ 2 
OLNI /SYVaW/ WOUd SENIVA SALN4WOD YvddW SNILNOU YadTSH D 
SINANOdXG ATLSOW ‘SETIVO Lad NI G3SN SLNIWNSYV SATOH /DUVAW/ 9 
[dd FYOLS SSVW ONINNOY YOd IN4GSN /LNIAW/*/TWAaW/*/DUVAK/ SVEYV NOWHOD 2 
2 
QZSN ‘MOUN ‘NUN ‘AELN ‘AGEN ‘LCUN *LGLN ‘(¥)VWON /LNT4W/ NOWNOD 
3ZIS ‘HOOU ‘NIGH “MIGL 'ATda *|WON ‘LWaL *(P)WWIG /T¥AaW/ NOWHOD 
MVaI ‘XSOI ‘XIGI ‘IVOS ‘MIGI ‘NOSI ‘WIGN ‘(})VXBW /9YVAW/ NOWHOD 
2 
AVUUV LNVLINSTY YOd AUVSSAOGN SV SOUVT SV VANE NOISNSWIG 9 
SUOLS SSVW LSV4 SALVINWIS WO1/EYOO GEGNSLXE NI vaneT 9 
2 


(892z€) Vana /WOOLa/ NOWHOD 
vane ‘€13AaT 
F) 
Po) 
*vaN@ AVUYY HO (XE ITdWOD HO ‘IVU) AdAL LNGUTdaIG O 
LaS 'TTIM SENILNOWGNS LNUS4aIG ‘Lad SIHL NI ‘vaNG AVHYV ONTAYOM D 
NVYLUOA NI GNY ZYOLS SSYW NI HLOG@ ‘SLNAW1a ** “OVWI/1VSN/OVWI/IVae 2 
ONILVNUGLIV SV LSIXS LSAW VIVO X3T4WOD 3dAL LVHL T1SM 3LON 2 
Fe) 


(LNdLNO=SadVL* LNANI=09SdVL‘ LNdLNO* LNANI )WOLWOT WVEDOUd 


2 
=" 
Gad WOT/THOD ATANSLXE YaAGAD ANY 0009 VLVG TOYLNOD 9 

WOLWOT :Wv¥DOUd LSaL 2 


Na 
NuOLTE 
(0 ‘t= ‘ac ‘aN ‘van@ ‘NN1)SWLIUM TIVO 


] 
S@N1VA IV3Y GN ‘SYOLS SSYW OL Vane WOUd “AC XSGNI *XOOTE ALIUM O 
2 


GIMMaW KYLNG 
2 
NuOLay 
(ac ‘aN ‘van@ *NON1)SWava¥ TIVO 


(aN) vane ‘Ivau 

(ZLS)XONIW ‘NOI /HODLEE/ NOWKOD 
Be) 
SGN'1VA ‘IVaY GN ‘V4NG OL TYOLS SSYW WOUd ‘GC XEGNI ‘XOOTE avau 9 
2 


(Gaso gad NVO SOWDVW WHLINM ‘WOVE HO MiNd “MLED *NOILIGGV NI) 9 
WOT YO FYOD GHGNSLXA ONISN SANILNOUENS SZATLVNUSLIV OSTY aaS D 
3. 

(L- WO O=a%VaT aI SSA1 HO L=NVdI 4I (1+XSGI-W)**7=0aUN TYSHM OD 
(0* L+Oa¥N*AVEYVXGNI*NDT) SWNEdO TIVO “9a !ATSNOIARYd 2 
GgN3d0 NAS@ SAVH LSNW /WODLId/NOWNOD NI NNT LINN TVOIOOT) 9 


(ac ‘aN ‘vane)avauaw aNIZNONENS 


dd YOd SENILNOU O/I FHOLS SSVW BAGAD GNV 0009 ViVd TOULNOD 2 
LIMMaW ‘GVEYaN :SENILNONENS 


ana 
a0Ls 
(pI ‘wwar ‘Ho . 
*LOTWOD /INIAW/ TIV LON HPZ “HO TIVWS OOL GEOUOd NAGI HSZ) LVWYOE 7666 
wUSI (Z666'd1) GLIUM O€L 


3 
401s 
el 
WdId = OWaId (OWdIG"LO"WdIG) aT 
(ste ‘= ()vxaH HOL ‘EI * 
‘= MVdI HE ‘EI ‘= XSI HS ‘EI ‘= XBGI HS ‘EI ‘= UIGI HB . 
‘er ‘= NOSI HB ‘EI ‘= WIGN HB ‘XL ‘P°lLa ‘ daIG XVM HOL) LVWHOd £666 


(WIGN* t=C°(C)VX3H) ‘XVdI *XSOT * 
‘xd ‘UIGI ‘NOSI ‘WIGN ‘WaIG (€666'd1) ALTIUM (0°SO*INIUdT) aT 


Py) 
(aHVa IVILINI SV SWVS 3@ GINOHS) SLINSAY ASUSANI INIYd 
re) 


@ONILNOD O0ZL 
@ONIGNOO Ole 
ONTA + OVA = O1VA 
((pela *xz)€ ‘ST ‘xL) dvwuod 
ald ‘MIVA ‘WH ‘I (¥666'd7) SLIUM (O°LO"ANIYAI) AT 
41d = Wala (WaIG"LO*aId) aI 
(O1vA-Wa)sav = did 
((1)vango) Ivae = Wa (0°OR'aWYI) aT 
(1)van@ = WH (0°EN’4WYI) aT 
ANON‘ =I OLL OG 


v666 


2 

(3a3H LGUN 4O ,SGO3Y, LGLN 3SN GINOD ASIMMSHLO HLONAT LNaYadaIG 4O 9 
S$Q93u, LdFSOV LONNVD (SWLIUM/SWGVSY ONISN) LIYMAW/GVEYAW YAGAD ‘ALON) O 
(avdaW A@ GELN4WOTH) AGLN ONITVLOL *HLONS' AGUN 4O ,SGOGY, AvaY O 


2 
(ao ‘WHUN ‘vane )avaudW TIVO 

MGIN' =f O71 Od 

“oO = IVA 

“O = Wald 
2 
“NANI WOGNVY IVILINI HLIM LINS3Y BSYSANI Lad SAUVAWOD ‘MOTEE O 
P 
(X1dWO YO ‘Ivay ‘XOO1G Lad NI SLWIS dO YSGWON SI LNON) 2 
MOO1G Udd NI STVY AGYN 4O GWON IVLOL AGLN ‘NLNOU Yad IaH D 
Fe) 


@/ENON = “NON (0'OS"dWYI) aT 

GUN = LNON 

O£L O% OD (O°EN'WUAI) AT 
(O*aWHI)uvaaW = HYaI OOL 


(4aIGHy *XOl ‘LO4NIHS *X9 ‘WeeZ/LadHe “Xp ‘XSGNI HB) LYWYOd 
($666°a1) 3L1uM 
(WIGN' L=o* (2) Vxa) * 
“avd ‘XSOI ‘X@aI ‘WIGI ‘NOSI ‘WIGN (8666‘d1) SLIYM 
aWHI ‘INIYdI (6666'd1) JL1uM 
Py 
INdLNO ISAL YOd SONIGVSH INIUa ‘MOTaa O 
2 
00L OL OD (O°ST°ENINdI) AT 


2 
AVYUY SWHOASNVUL SSUAANI LaaWO SNILNOU HO O 
Fe) 


(xaoI ‘xaaI * 
‘vana ‘IvOS ‘MIGI ‘NOSI ‘WIGN ‘VXSW)LaaWO TIVO (0'OS'aWUI) aT 


PI 
‘Ivau GgxOVd OL AVUY SWHOASNVUL ASHEANI LadWu SNILNOU USHLIT O 


1.5-32 


‘Wau GaNOVd OL AVYYV SWHOASNVHL SSHBANI LagWu GNILNOY YSHLI O 
2 
(aval ‘xgor ‘xaar . 


‘WIGN ‘VXEW)%daWa T1VD (0°SN"4WHI) aT 
gZIS/"L = TvOS 


uIgI- = ular 
E NOSI- = 


NDSI 06 
2 
g (IVaU-OL-X9TdWOO) WHOASNVEL ASHZANI WO4 YIGI GNV NOSI LUSANI ‘MOTSE D 
2 


‘yana ‘IvOS ‘YIdI ‘NOSI 


SQNILNOD 08 
SONILNOD == OL 
(peetaz ‘xz ‘ST *XL) LvWuod 9666 
(1)vango *XSGNI (9666'd1) 3LTuM 
04 OL OD (0°@T*“NINAI) aT 
t - ¢ = XN 
INON'L=I 04 Od 
2 
WOLS SSVW YSGAD NI SV APUN'NGLN 4O GVALSNI FYSH |GUN‘ IGEN 3s NVO OS D 
SHLONGT LNIUGddIG 40 ,SGYOOTY, La¥I0v NVO LIMMAW/GVEYAN ,HOT, ‘BLON) 2 
(AvadW AG GALNdWOOTY) LGLN ONITVLOL ‘HLONTT 1GUN dO ,Sdoau, avaY D 


2 
(ac ‘GUN ‘van@)avauan TIvo 
GNON® (1-82) = % 
LGLN* t=af 08 Oa 
2 
AI ‘NOSTYVANOD WHO GNV) LINSIY XaTaWOD 4d SSIDOV NVD WYHDONd “MOISE 
2 
(SUWId INON ‘SLVLS Xa'1dWOD NI VLVO YOd |+=aW4I ALON) O 
VLOL (GIN ‘NSWIG LSYId NI SLW13 dO WON ZNON ‘SNILNON UadTaH O 
2 
Z/LGUN = NON 
O€L OL OD (O°SN"WUSI) JT 
(O*a4WaI-)uvddW = Bear 
2 
(LaaHe ‘X71 ‘XSGNI HB) LVWUOd L666 
(£666'a1) 3LIEM 
(Ste ‘= ()VXBW HOL ‘€I “= NvdI HB ‘EI ‘= XSOI HO ‘EI ‘=HL . 
‘xgqI HZ ‘€I ‘= UIGI H@ ‘€I ‘= NDST He ‘€I ‘= WIGN HB) LVWHOd 8666 


(WIGN (2) vxaM) . 
‘aval ‘XSOI ‘XdGI ‘MIGI ‘NOSI ‘WIGN (8666‘d1) 3LIuM 
aWHI ‘INIWdI (6666'd1) SLIUM 


5) 
LNdLNO LSAL YOd SONIGVEH LNIYd ‘MOTE O 
Fo) 
06 O OD (O°ST'LNIWAI) aI 09 
2 
INSTA XATANOD OL AVYYV WHOASNVYL OL L44W ANILNOM TYOLS SSVH XETAHOD O 
2 
(XO ‘XSI ‘van ‘IVOS ‘MIGI ‘NOSI “WIGN ‘VXW)LaaWO TIVO 
2 
WOLS SSVW MAGA NI SV AGUN‘NGLN dO GVSLSNI GUSH |GUN'LGIN aSN NYO OS 9 
SHDONS'] LNGUaddIG dO ,SCHOOEH, LdZOOV NVO LIUMAW/GVSYAN ,WOT, *SLON) 
HLONGT LGYN JO ,SGOaY, NI AVHYV X¥TdWOD NI NOILONNA dWvd GvOT 3 
2 


SONILNOD 0S 
(ae ‘LGUN ‘vana)LIeMaW TIV 
SQNILNOD OF 
ONIA + MIVA = O1VA 
(o‘nIvA)xIaWwo = (I)vango 
INON' {=I OF Od 
LGN‘ t=ae oS OG 
Z/ENON = LNON Of 


Section 1.5 


vo 


DOT Ldd NI SLWIZ X14WD dO WON LNON ‘LdaWO SNILNOU XBTdWOD BSN ‘MOTSE 


09 OL 09 
“INSTA XITAWOD OL AVWAV WHOASNVAL OL LaaW4 SNILNOY SYOLS SSVW ‘TVSu 
(3vdI ‘XdOI ‘xa@I ‘vane ‘IvOS ‘HIGI ‘NOSI ‘WIGN ‘VXSW)LaaWa TIVO 


HOLS SSVW USGAD NI SV X@UN‘NGLN 40 GVALSNI SUSH LCUN'LGLN gSN NVO OS 
SHLONGT LNEWadaIG 40 ,SHOOSY, LdgI0V NVO LIUMAW/GVSUAW ,WOT, ‘SLON) 
HLONST (GUN 40 ,SGOTU, NI AVYMV TVS NI NOILONNA aWv¥ aVvOT 


@ONIGNOD 0z 
‘vaNd)LIuMaW TIVD 
@QNILNOO oL 
ONIA + DIVA = OVA 
oivA = (1)vane 
NON‘ L=I OL OG 
LGIN‘L=a¢ 0z oa 


(ae *LauN 


MOTS LadWY Ivey ‘0S LV J. SNILNO¥ X@1dWOO YOd HOLIMS 
J€ OL OD (0°OS"AWYI) aI 
aZISs/*t = ONIA 
‘0 = MIVA 
“t= qvos 
6€‘WIGN'VXW)WNSaW = W 
TVLOL (GIN ‘N3WIG LSYId NI SLWIS JO WON LNON ‘SNILNOU wad IaH 
LauN = NON 
O€L OL OD (O°SN'WNAI) aT 
(| aWaI)YvddW = wuaT 


STV3U XIOIe*z VANG ‘SIVEN XSGI**Z SHOOT BYOLS SSVW Lda 
‘NSWIG Z ‘SLWIE 9¥*Z JO SMOW Beez ‘SOUV Idd THON 

€L = xgor 

4 = Xaer 

@ = WIaN 

9 = (2) VXaW 

8 = (L)¥xXaW 

“0 = OWdIG 


(/ (SHE . 


“SL LadWu=|'LSaL LaaWO=0) HSZ “EI *= AWUI HG ‘*(SdaId XVWHLL * 


evvvKv vvo UO 


vou 


vuvv 
1.5-33 


*sQ'SMOIdOO=1) HbL ‘EI ‘= LNIWdI ~ MSIL Lad THOLS SSVWLHLE) LVWYOd 6666 


4aWaI *UNTHdI (6666 1) SLIUM (O'S TINIMAT) aT 


LNdLNO LSaL YOd SONIGVSH INTYd ‘MOTaE 

(%aaW) Gas LON *(LaaWa) 1- YO 0 ‘L=xvaT 

(%daWO) 0 HO L=¥IGI ‘(LadWa) 1-=aIGI ‘| -/+=NOSI ‘sou Lad 
t = dvdr 
t- = urar 
t- = NOSI 

SSL LadW SNILNOU XBIAWOD 0 ‘LSAL IdawW ANILNOU ‘IVa 1-=aWyT 
L- = awar 

KINO SSONSUS4aId XVW 0 ‘SMOTdOO L+=LNIUdI ‘LINN IVOIOOT USLNIUd SI a7 
0 = INIWaI 
s= di 


2 
Fo) 
Fe) 
° 
Fe) 
FE) 


2 
Pe) 
Pe) 


2 
2 
ro) 


3] 
O/I 3HOLS SSVW Lt ddd ¥O4 LINN TVDIDOT SI NONI D 
° 
b= NOT 
2 
heal WVuSOud GNV Lid HOd FYOLS FYOD NI VV ONIXYOM SI ()vango=()vang 3 
& 2 
3 ((t)vana*(L)vang>) gonatvaroog 
= (poz) vane Ivay 
6 (vZ0L) Vana xaTawoD 
2 
“UvddW ANILNOW *SLNSWWOD 3aS 2 
/TWAAW/ WO%d /DAVAW/ AWOS JLNdWOO-aSUSARY NVD 4wo > 
(ssOd 4I SLNZIVAINOS YROSLNI) /INIAW/ “(douvI 3WOS SV SIVa4) /IVAaW/ 9 
OLNI /OUV4W/ WOUd SEN IVA SBLNdWOD UvaaW SNILNOU WadTaH 3 
SINENOdX3 AILSOW ‘SATIVD Lad NI G3SN SLNSWNDUV SQ@IOH /DUVa4W/ 2 
dd 3HOLS SSVW ONINNOY 4Od INaasN /LNIAW/* /"IVAAW/* /DEVAW/ SVEXV NOWWOD 2 
2 
SZSN ‘MOUN “NEUN ‘AGLN ‘WEAN ‘1GUN *LGLN “(b)WHON /LNI4W/ NOWHOD 
SZIS ‘MOOM *NTGY 'ATGL *HTGa ‘WON ‘LWGL ‘(%)VNIG /T¥AaW/ NOHWOD 
WVdI ‘XSI ‘XSGI ‘IVOS ‘MIGI ‘NOSI ‘WIGN ‘(p)VXEW /9¥VaW/ NOWWOD 
2 
O/I SHOLS SSVW YOd YAWNN LINN IVOIOOT SATOH /WOOLAd/ NOWWOD 3 
2 
NOT /WODLAa/ NOWWOD 
2 
2 
“Va AVHYY HOE (XATdWOD HO IVEY) BdAL INSYsaata D 
JaS TTIM SHNILNOWGNS INAYS44IG ‘ddd SIHL NI ‘Va AVEUY ONIXXOM D> 
NVULHOd NI GNV GYOLS SSVW NI HLOG ‘SINEWH1G **“OVWI/IVaY/OVWI/IVaE D 
ONILVNUALIV SV LSIXS LSAW VIVO XB14WOD 3dAL LVHL TISM 3LON 3 
2 
BS yea aa 
@IdWVS Ldd O/I AYOLS SSYW LL ddd :Wy4DOud isaL 2 
=e fess pai 
2 
ana 
NuNLae 
(GN *(L+8Ne(t-ae))vanaT ‘vang)AaTAON TIVD 
) 
SAN IVA IVa¥ GN ‘S¥OD GSGNSIXS OL vane WO ‘AC XSGNI ‘OTE BLTUM > 
2 
LIYMAW ABLNG 
x 
NuNLay 
(GN ‘van *(1+GNe(1-ae)) Vang) AaTAON TIVO 
2 
(GN) vane Ivaa 
(8942€)V4N@1 /WODLaa/ NOWKOD 
vanal ‘€1g3Aa7 
2 
S3N1VA ‘Ivau €N ‘Vand OL BHOO GAGNSLXE WOU ‘aC XAGNI ‘¥OOTE avay D 
2 
“(IN3Saud LON aI OSId WO¥d agaSszDDv AINO GNV au0D GgGNaLxa 3 
NI GTSH SYOLOGS ANVW - WHLIYOOIV AYOWAW TvOLUIA 3SN) 9 
AUVSSAOGN NAHM AIId YIOUVI SSEOOV OL SOMDWW WaLIMM/Wavad 2 
F HLIM GENIGWOD 3 GINO aSN 340d GgGNaLXa “AIGALLVNUSLIV 2 
2 
o (SAVHYV JOVI HOI AUVSSEOSN SV GOUVI Sv vanaT NOISNSWIG 3 
Pa ~ 3HOLS SSVW 4O 3OV1d S3XNVL WO HO 3uOD GgGNaLxa) 2 
5) 
f (ae ‘aN ‘Vand)dvauaW SNILNOusns 


Uda YO4 SANTINO O/I 3YOLS FYOO AAGNSLXS YAGAD ANY 0009 VL¥d IO¥LNOD 5 


LIYMAW ‘avauaW :SENILNOwENS O 


dois 

(yI ‘waar ‘HO * 

“LOSHYOD /LNIGW/ TIV LON HPZ ‘YO TIVWS OOL GSOYOd XSGI HSZ) LYWYOA 
WMA (2666'd1) ALIUM OfL 


7666 


3 
a0Ls 
2 
WaIG = OWaId (DWaIG*LO‘Wald) at 
(ste ‘= ()VXN HOL ‘eI = + 
‘= MVdI HB “EI ‘= X3OI HB ‘EI ‘= XSGI He ‘EI ‘= UIGI He + 
“EI ‘= NOSI HB ‘€I ‘= WIGN HB ‘XL ‘P‘Lia * aaIq XVW HOL) “YWYOs £666 
(WIGN* L=0°(£)VXSW) “Ava ‘XaOT * 
“XSGI ‘HIGI ‘NOSI “WIGN ‘W4IG (£66641) SLIUM (0°SO'LNIUAI) aT 
2 
(4WV4 IVILINI SV GWVS 3@ GINOHS) SLINSAY ASYSANI GNINd D 
2 


SONIGNOD OZ 
SNNILNOO OlL 
ONIA + Q1VA = OVA 
((p'€la *xz)€ “ST *XL) Lvwuoa 
41d *N1VA ‘WY I ($666'd1) BLIUM (O°LOLNIMAI) aT 
did = WalG (WdId"LO*dIq) aI 
(O1VA-Wu) Sav = 41a 
((1)vanao) Ivaa = WH (0°OS"aWYI) aT 
(1)van@ = Wa (0°3N'aWHI) aI 
ANON‘ L=I OLL Oo 


HOLS SSVW ¥AGA9 NI SV WGUN‘AGLN 40 GVALSNI 3YSH LGYN‘LGLN aSN NVO OS 
ONS INAYS4dIG JO ,SCHOOSY, LdgIOv NVO LIYMAW/GVSYAW ,WOT, *SLON 
(4vdaW A@ GALNAWOOTY) LGLN ONIIVLOL ‘HLON’' LGN 40 ,Sdogu, avau 


vovuuu 


1.5-34 


(ae ‘(GUN ‘van@)avauaW TIVO 
IGIN*L=ae OZL od 
“Oo = o1VvA 
‘oO = ward 


GO4NI WOGNVY IVILINI HLIM LINSSX JSUTANI Lad SauvaWOD ‘MOTRa 


(XIdW9 YO Iva ‘HOOT Lad NI SLWTS 40 YAWN SI LNON) 
‘WLOL (GIN ‘NWI LSHId NI SLWIS 40 WON LNON *SNILNOU uaa IaH 


vovvvn 


@/UNON = GNON (0°OS*aWHI) JT 

tayN = LNON 

O€t OL OD (O°SN'wUaT) aT 
(O*d4WHI)avaaW = wuaI oOL 


(4aIGHy ‘XOL “LMANIHS *X9 ‘WeeZ/ddaHe ‘Xp ‘XSGNI He) LVWYO 
($666'd1) 3LIuM 

(WION* L=0* (£) ¥XaW) * 

“XSI ‘UWIGI ‘NOSI ‘WIGN (8666'd1) BLIUM 
4WHI “INIUdI (6666'd1) JLIuM 


“avdI ‘xaOr 


LNdLNO LS3L YOd SONIGVSH LNIMa ‘MOTaa OD 
001 OL OD (O°ST*LNIMAI) aT 
AVUY SWYOASNVUL SSHAANI LddWD INILNOY YO D 


(xao1 ‘xaaT * 
“vaN@ “IVOS 'WIGI ‘NOSI *WIGN ‘VXSW)ddaWD TIVD (0°O3"4WYI) aI 


MSFFT 


Section 1.5 


(IVa¥-OL-XaTaWOO) WHOESNVAL ASHFANI YO UIGI GNVY NOSI LYZANI ‘MOTSE 
2 
SQNILNOD 08 
SONILNOD on 
(preraz ‘xe ‘SI ‘xXL) Lvwwod 9666 
(1)vanad *XSqNI (9666‘d1) SLTUM 
OL OL OD (O°ST°ANIWdI) 41, 
t - 2 = XaqNT 
NON‘ {=I 04 OG 


(3Y3H [GUN JO ,SGOY, LGN FSO GINO SSIMMSHLO :HLONAT LNAUSasIG 40 
,SOaY, Ld¥OV LONNVD (O/I NVMLHOd ONISO) LIUMAW/GWS¥AW LL ddd ‘LON) 
(avddW AG GILNAWOITY) AGLIN ONITVLOL ‘HLONST AGEN 40 ,SdITx, AVEY 


vv00”0 


(go ‘N@UN ‘vane)avayaN TIVO 
GNON*({-Gl) = ¥ 
MAIN’ L=El 08 Od 


aI ‘NOSTUVdWOD WHO GNV) LINSSY XBTdWOD dad SSTOOV NVD WYHDOUd ‘MOTE 


(SWI “NON *SLVLS XS14WOD NI VIVd ¥Od | +=4WuI SLON) 
MOOI Idd NI STVSH AYN dO GWON TVLOL XGIN *NLNOY Yad TSH 


vvvvK0K 


Z/M@UN = LNON 

O€L OL OD (O°SN'WYSI) AT 
O€t OL OD (O°SN'WUSI) aT 
(O*aWuI-)uvdaW = wear 


(GaaHe ‘XZL ‘XSONI He) L¥WuOd 

(£666'd1) aLIuM 

(sre ‘= ()VXBW HOL ‘EI *= NvdI HB ‘EI ‘= XEOI HB ‘EI “=HL . 

‘ xgaI HL ‘€I ‘= WIGI He ‘eI ‘= NOSI He ‘€I ‘= WIGN HB) LVWYOd 8666 
(WIGN' L=c* (2) ¥XaW) . 
‘NvaI ‘XSOI ‘XSI ‘MIGI *NOSI ‘WIGN (8666‘d1) 3LIUM 
aWHI ‘LNTUdI (6666'd1) SLIM 


LNdLNO LSaL YOd SONIGVEH INIYd *MOTEE 

06 OL OD (O°ST™ANIUAI) 4I 09 

VINSSU Xa1WOO OL AVY WHOASNVAL OL LaaWD ANILNOU TAOLS SSYW Xa1dWOD 
(X30 'XGaI ‘vane ‘1VOS “HIGI ‘NOSI ‘WIGN ‘WXSW)LadWo TIVD 

(3¥gH LGYN 40 ,SGOd¥, LGN ASM GINOD ASIMUSHLO ‘HLONAT INaYaddIG 4O 


»SQQ3U, Ld¥OOV GONNVD (O/I NVULYOA ONISN) LIMMAW/GWaUAW LL ddd ‘LON) 
HLONT YSN dO ,SGOTU, NI AVYYV XATMWOD NI NOTLONNd dWVY AYOT 


ev0uKD VOO VOY 


SONILNOD 0S 
(ac ‘X@yN ‘vaNd)LIuMaW TIVD 
SOQNILNOD OF 
ONIA + MIVA = O1VA 
(*O‘O1WA)X1dWo = (I)vand 
NON‘ L=I OF Od 
MGLN'L=8f 0S Od 
Z/LNON = LNON O€ 


D018 dd NI SLW1a X1dWO JO WON INON ‘LdaWO SNILNOW XaIdWOD ISN *MOTIE 


09 OL OD 


LINSSY XSTAWOD OL AVHYY WHOASNVUL OL LadWa ANILNOY ANOLS SSVW IVEY 


vou vou 


(aval ‘xdOI ‘XaaI ‘vana ‘IvOS ‘HIGI ‘NOSI ‘WIGN ‘VXEW)LdaWe TIVO 


3) 


(aH LON JO ,SGOZH, LGIN JSN GINOD SSIMYSHLO :HLONAI INGUSadId JO 9 
,SQQda, LagOV LONNVD (O/I NVYLHOd ONISN) LIAMAW/GVSYAW LL ddd ‘3LON) O 
HLONS1 YeYN 40 ,SGITX, NI AVY IvaY NI NOILONDE dWve GVOT O 
e) 
SONILNOD 02 
(ac ‘MEAN ‘vand)LINMaW TIVD 
@ONILNOD =O 
ONIA + OIVA = NIVA 
ova = (1)vand 
ENON‘ =I OL OG 

MAIN’ t=al 0Z Od 
F] 
MOTS@ LaaWY IvSX ‘OS LY LadWO INILNOW XITEWOD YOd HOLIMS O 
E) 

0€ OL OD (0°OS"aWUI) AT 

aZIs/*l = ONIA 

“0 = O1vA 

*L = IOS 

(66‘WIGN' VXaW)WASaW = W 
2 
SNOOTE IVLOL WAIN ‘NOOTA Lad NI SUWTG dO WON LNON ‘SNILNOU WadISH 
bE) 

MAIN = LNON 
Bo) 
(azIS g1Id WOWIXVW SV AG4N SNUNLIY UVddW NLOOU UIdTaH BLON) O 
Dau Yad SGUOM Z*AUN ‘AGAN-OFU WON HLIM GENIdO TYOLS SSWW 11 ddd O 
2 

(XGNI‘O‘GMN‘X@4N)NO1 Fa INIAga 

ZeXeUN = GMN 

(0* VG" LSidd, ‘NN1)NOISSV TIVO 

O£L OL OD (O°SN'HYaI) aI 

(O*aWHI)YVdaW = YYII 
2 
STVau XSOIe+z Vana 'SIVEY XIGI*+~ SXOOTE AYOLS SSWW Lad O 
“NEWIG Z "SLWIE 9**% JO SMOU Beez ‘SOUV Lad TYOW D 
cS) 

LL = xdOr 

“= xgaI 

Z = WION 

9 = (Z)VXaW 

@ = (L)vxXaW 
E) 

‘0 = OWdIG 


(/ (USHE . 

“aL “daWY=L'ISGL LadWO=0) HS ‘EI ‘= aWHI H6 **(SdadIG XVWHLL . 
*sQ'SMOIdOO=1) HbL ‘€I ‘= LNIWdI - LSGL Lad THOS SSVWLHIE) LYWYOd 6666 

WAI ‘LNTHAI (6666‘d1) GLIUM (O°ST°INTYdI) JT 


ro} 
INdLNO SAL YOd SONIGVEH LNINd ‘MOTSE O 
3 
(L4aW) GaSN LON ‘(Laawa) L- 8O 0 ‘L=avdI O 
(4aawO) 0 HO |=¥IGI *(LaaWy) L=4IGI ‘| -/+=NOSI ‘souv Lad 
B) 
t= wVvdI 
t- = ular 
t- = NOST 


2S: 
SSL LaaWD ANILNOU XBIAWOD O ‘LSAL daw ANILNOY Iva L-=4WyI 9 
=) 
L- = aWar 
KINO SSONSUS44Td XVW 0 ‘SMOTdOD 1+=LNINdI ‘ZINN IVOIOOT YALNIUd SI d1 9 


0 = INIuaT 
s=di 


1.5-35 


Chapter 1 


FFT Programs 


*vaN@ AVWYV HOs (XBTaWOD YO IVAN) FdAL INTAadaIG 


aS TIIM SENILNOWGNS INSUS4dIG ‘Lad SIHL NI ‘vane AVHYV ONINYOM 
NVYLYOd NI GNV GHOLS SSVW NI HLO@ ‘SINAW31S **“OVWI/TVE¥/OVWI/TVE 
ONILVNUSLIV SV LSIXS LSOW VLVd Xa1dWOO AdAL LVHL TISM GLON 


O/I NVULYOd GUVGNVLS NVHL LNAIOIdda 3YOW SI O/I ONOWW LSV4 IVHL 3LON 


(04 SNII 3S - O/I YOd AIA NAdO OL OYOVW WALSAS OL TIVO SauINOTx) 
WdWVS Ldd O/I OWDVW LSVd LL ddd :wvudO¥d LsaL 


vovvvvvVL0000U 


NunLae 
vana(ae,NO1)aLTEM 


vu 


(aN)vang TvaE 
NOT /WODLGd/ NOWNOD 


SEN 1VA IV3U GN ‘SOLS SSVW OL Vand WOUd ‘AC XSGNI *XOOTE GLIUM 


2 

2 

2 

(4HLLGE SEWIL 01 OL Z GAadS GONIS ‘Gawusaaud 3a OL FV ASGHL) 9 
SHNILNOWGNS O/I OYOVW LSV4 ‘SAILVNYSLIV OSTY aaS 2 


(L- YO O=NvdI 4I SSHT YO (L+X3GI-W)**Z=OTUN GNV (1+X3GI)*+Z=GMN FSH 
(XGNI‘O*GMN‘OTYN)NOT AIIa aNIagaG anv 
(0* ,AWWNA1I4,*NO'1)NOISSV ‘TIVO ‘oa !ATsNOIAgaa 


QaNadO NEG@ FAVH LSNW /WODL44/NOWWOD NI NOT LINO TYDI901) 


(ae ‘GN ‘vaNa)LIuMaW SNILNONENS 


dd YOd SNILNOW ILIUM SSIOQV LOaUIG NVULHOd Lt ddd 
LIuMdW :SNILNOwENS 9 


ee ES Eas 
2 
ana 
nuoLae 
vane (af NNT) vay 
2 
(aN) vane ‘Ivau 
NOT /WOOLEd/ NORWOOD 
2 
SAN1VA IVdU GN ‘V4NE OL HOLS SSVW WOUA ‘AC XAGNI ‘XOOTE avay D 
2 
(49LLaG SAWIL 01 OL Z GgadS JONIS ‘GguNaaa¥d BG OL FHV ASAHL) D 
SANILNOWGNS 0/1 O¥OVW “SV4 ‘SAILVNYSLIY OSTV aaS 0 
5 
(L- HO O=HVaI aI SSAT HO (1+XAGI-W)+*7=OSUN GNV (1 +X9GI)**Z=GMN SYSHM O 
(XGNT'O‘GMN‘OSUN)NOT IIa aNT4aa anv 2 
(0* ,SWVNA1Id,*NN1)NOISSY TIVO “9a ‘AISNOIAgYd 9 
G3NZdO NASE JAVH LSAW /WOOLAE/NOWNOD NI NONI LINN ‘I¥OI901) 9 
FS) 
(ac ‘aN ‘vaNe)ava¥aW aNILNOwENS 
2 
ASgre se Sas aa 5 


Uda YOd ANILNOU GVEY SSIOOV LOAYId NVHLYOd LL ddd 
avauaW :3NILNOwsAS 2 


as ats 5 ORE 5 


Fe) 


a0Ls 
(pI ‘waar ‘HO . 
“LOguYOD /ENIAW/ TIV LON HZ ‘HO TIVWS OOL GaOd XSHI HSZ) LwWuOd 7666 
wuaI (Z666‘d1) BLIUM OFF 


dois 


WaIG = OW4IG (OWAIG"LD"WaIG) aI 
(STe€ *= ()VXEW HOL ‘EI * 
‘= avdI He ‘EI ‘= X30 HS ‘€I ‘= XdaI He ‘€I ‘= YIGI He = * 
“eI ‘= NOSI He ‘€I ‘= WIGN HB ‘XL ‘P°LLS ‘ ddIG XWW HOL) LVWHOS £666 
(AIGN' L=0'(0)VXEW) ‘XvdT ‘xgOI + 
‘XdGI ‘WIGI ‘NOSI ‘WIGN ‘W4IG (€666'd1) SLIMM (0°SD°INIUdI) AT 
Po) 
(ava IVILINI SV SWVS 38 GINOHS) SLINSSY FSUBANI LNIYd 2 
2 
SONILNOD O0ZL 
@ONILNOD = OL 
ONIA + OIVA = OVA 
((prela 'xZ)€ “ST ‘XL) avWuOd 
41d ‘MIVA ‘WH ‘I (p666'd1) BLIUM (O°LO*’INIYdI) aI 
ald = WaId (WaIq"L9"4Id) aI 
»  (NIWA-Wa) SAV = 4a 
((1)vang9) Ivau = WH (0°OS"aWYI) aI 
(1)vane = WH (O°SN*aWYI) aI 
INON'L=I OLL Oa 


666 


(@WaH LGN 4O ,SGOau, LGLN GSN GINOD 3SIMYSHLO +HLONS' INSYSddIG JO 
/S9aax, LdaDOV LONNVD (0/I NVULYOd ONISN) LIUMAW/GVEYAW LL ddd *3LON) 
(4vdaW A@ GELNdWOOTH) AGIN ONITVLOL ‘HONS AGYN dO ,SGOau, avau 


woven 


(ae ‘NEYN ‘vaNe)avayan TIVO 
WEEN L=€l 0ZL OG 
“O = OIVA 
‘oO = Wald 


GOdNI WOGNVH ‘IVILINI HLIM LINSSY ASHBANI Ldd SauvaWOD ‘MOTaE 


(X1dWD HO Ivae ‘HOOT Lad NI SLWIG JO USEWON SI LNON) 
NOOTE Idd NI STVaY NGYN dO GWON IVLOL XALIN ‘NLNOY UsdTaH 


vuuuvyg 
1.5-36 


Z/GNON = GNON (0°OS*4WHI) JT 

X@UN = LNON 

O€L OL OD (O°SN*WUSI) aT 
(O*aWHI)UvdaW = YAII O01 


(4aIGHy *XOL ‘LMANIHS ‘X9 ‘We*Z/ddaHe ‘Xb ‘XBGNI HB) LYWYOd 
($666°d1) SLIuM 

(WION* L=2* (0) ¥xaW) * 

“aVdI ‘XSOI ‘XaGI ‘MIG ‘NOSI ‘WIGN (8666‘d1) 3LIUM 

aWHI ‘INIUdI (6666'd1) 3LTUM 


LNdLNO LSaL Od SONIGVSH LNIWd ‘MOTE 9 
00l O% OD (O°S1"ININdI) aT 
AVYUY SWHOASNVUL FSUYFANI LddWO ANILNOY YO D 


(xgoI ‘xaer . 
‘vaNd “IVOS ‘HIGI ‘NOSI “WIGN ‘VX3W)14aW2 TIVD (0°Oa'4WHI) aI 


‘IW3u GaXOVd OL AVHUV SHHOASNVAL ASUBANI LddW4 INILNOY USHLIG O 


(QivdI *xgo1 ‘xaar . 
‘van ‘IvOS ‘HIGI ‘NOSI ‘WIGN ‘VYX@W)ddaWe TIVD (0°SN*dWUI) dT 
gZIS/‘| = ‘IvoS 
‘4uIgI- = urar 
NOSI- = NOSI 06 


MSFFT 


Section 1.5 


06 OL OD (O°STENIUdI) aI 09 
LINSIY XAIAWOD OL AVYAV WHOASNVYL OL L4dWD SNILNOY SHOLS SSVW XITaWOO 
(4391 ‘XSI ‘vane ‘IvOS ‘MIGI ‘NOSI ‘WIGN ‘VX3H)LaaWo TIVO 


GS SSVW NVHLYOd NI SV AGUN‘AGLN 40 GVSLSNI SYH LGUN‘IGLN 3SN NYO OS 
HLONS'T LNYS4Id JO ,SCYOOTY, La4¥IOv NVO LIWMAW/GVEYAW ,OWOVW, *SLON) 
HLONST LON dO ,SGDa¥, NI AVHAY XBTdWOD NI NOILONNA dWV¥ GVOT 


SONILNOD 0S 
(ae *LGUN ‘vang)LIUMaW TIVD 
BONILNOD OF 
ONIA + OVA = DIVA 
(‘o‘n1vA)xXTawo = (I)VaNED 
AINON*L=I OF OG 
LGN b=ar 0S oa 
@/GNON = ENON 0€ 


+USUId, NI SLWIS X1dWO dO WON LNON ‘idaWO SNI“NOU XB1aWOD 3SN ‘MOTI 
09 OL 09 

GINSIY XA IdWOD OL AVHAV WHOASNVYL OL LddWY ANTLNOY FHOLS SSVW ‘IVaY 
(AvdI ‘X91 ‘xaaI ‘van ‘IVOS ‘YIGI ‘NOSI ‘WIGN ‘VXSW)LaaWy VIVD 


GS SSVW NVULYOd NI SV AHUN'AGLN 4O GVELSNI SUH LGUN‘{GLN 3SN NYO OS 
HLONGT LNEYSddId dO ,SQYOOSY, “d3OV NVO LIYMAW/GVEYAN ,OWDVW, ‘SLON) 
HLONAT LYN dO ,SGOaY, NI AVYYY ‘Iva NI NOILONNA dWVY aVOT 


SONILNOD 02 
(ge ‘LGYN ‘Vand)LIuMaW TIVO 
@ANIGNOO or 
ONIA + MIVA = OVA 
OIvVA = (I)vane 
GNON‘t=I 01 OG 
LGEN*L=ac oz oa 


MOTaH LddWY IVEY ‘0S LV LddWO SNILNOU XaIdNOD OA HOLIMS 
O€ OL OD (0°Oa"aWYI) aT 
SZIS/*L = ONIA 
“0 = O1VA 
“| = IWos 
(66‘WIGN‘VXaW)WOS4W = W 
SHOOT IVLOL LGLN *NSWIG ,LSHId, NI SLWTG dO WON NON ‘SNILNOU waaTaH 
Laan = LNON 
O/I NI SHOWN ON 4I OUSZ t/WOML4d/ NI WYSOI Lasaud 
0 = wugor 
(aqaI* ,LVa"LSabLd4,'NO'1)Nad0aW TIVD 
'SQHL ‘LIYMAW/AVEYAW ONOWW AG BSN HOd ‘(L10H) BSEWON TENNVHO 40 
/WODLI4/NOWWOD NI (WLLXSY) SSSYGGV Gdd-aGd4I ONINENLY * Lv" LsaLLaa, 
@1Id NdO G1NOD ,NadOdW, NILNOWENS AIAVTIVD NVULYOE V ‘SIaWVXI HOS 
144) NEdO*, YO (XSU) ,$NZdO, OYDVW WH“SAS SNOANI GNV NIT gAOgY aLa7g0 


/3UaH @'IId N3dO GNV NOISSY, dOLS 


vvveu vou vo 


vouvvu vou vou 


vou vou 


vouvvovuLv”n vou 


Py 
(3ZIS 11d WOWIXVW SV XBAN SNYOLAY YvddW NINOW WadISH ALON) 9 
Pe) 


O€L OL OD (O'SN*wUaI) ar 
(O*aWaT)avaan = waar 
=) 
SIV3U XdOI+*z vaNG ‘STVEU XAHI*+z SXOOTA FYOLS SSWW Laa 9 
“NEWIG Z ‘SWIG 9**Z dO SMOW B**z ‘SOUV Lad SHOW 9 
5) 
XSI 
xaar 


‘Oo = oWdIG 

(4 (USHE . 

“aL LddWa=.'IsaL LagWO=0) HS ‘eI *= aWYI HE ‘*(SaaTa XVWHLL . 
“sO‘SMOIdOO=1) HhL ‘EI ‘= LNIYdI - LSAL Lad AHOLS SSVWLHLE) LYWHOd 6666 

aWHI “INTYAT (6666'd1) ALTMM (O'AT"LNINAI) aT 


2 
UNdiNO LSaL ¥Od SONTGVAH INTYa ‘MOTE 3 
2 
(%44WO) G3SN LON *(LaaWY) 1- YO 0 ‘L=aVaI O 
(LaaW9) 0 YO L=4IGI *(LaaWH) L-=4IGI ‘| -/+=NOSI ‘souv Lad 2 
2 
t = wvar 
t- = uIar 
L- = NOST 
= 
USGL LddW ANTLNOW XATAWOD 0 ‘LSAL LdaWY INILNOY IVEY L-=aWaT 2 
5 
t- = awar 
2: 
KINO SHONSUSAdIG XVW 0 *SMOIdOD L+=LNIUdI ‘LINN IV9T9O1 YILNIYa SI aT 3 
2 
0 = INIWar 
S = aT 
Fe) 
O/I BYOLS SSVW LL ddd 4Od LIND IVOTOOT SI NID 
F) 
t= NOT 
EI 
WvuSOud GNV dd YOd AYOLS FYOD NI VaUV ONIXYOM SI ()vanao=()vang 9 
P) 
((L)vana@'(L)vana>) goNaTvAINO 
(sp0z) van vay 
(pzoL)¥ango xaTaNoD 
2 
*‘UvddW ENILNON ‘SLNEWWOO gas 
/TWAAW/ WOU /OXVAW/ AWOS 3LNA4WOO-SSUIATA NYO YO O 
(SSOd 4I SIN@IVAINOA YSOAINI) /UNIAW/ ‘(SDUVI SWOS S¥ SVN) /1VAaW/ D 
OLNI /SuV4W/ WONd SAN IVA SALNdWOD UVadW FNILNOY YadISH D 
SLNENOdXa AILSOW “SATIVO Lad NI GaSN SLNEWNOUY SQ'IOH /OUvaH/ D 
da a¥OLS SSVW ONINNOY HOd IN4asN /INIAW/*/IVAAW/*/DYVAW/ SVEYV NOWWOD 2 
2 
SZSN ‘MOUN ‘NEYN ‘NELN ‘WEAN ‘LGUN ‘LGN *(%)VWON /LNIGW/ NOWWOD 
ZIS ‘WOO ‘NIGY ‘MIG. ‘A IGd ‘LWON ‘LWGL '(%)¥WIG /TVAdW/ NOWWOD 
WVdI “X3OI ‘XSI *IVOS ‘HIGI ‘NOSI ‘WIGN *(¥)VXSW /DYVAW/ NOWWOD 
2 
(LIUMAW/AVINAW ANILNOY ODVW LSVd NI SLNAWNOD 3aS) 3 
(LLDH) “TENNVHO ‘(WLLXSH) O/I OYOVW HOE SSTYGGY add SGIOH /WOOLAd/ NOWWOD 2 
3 
wagOI ‘aqaI /WOOLdd/ NOWWOD 
5 


1.5-37 


(?p1 I38V1 ONIMOTION 2aS) HOWUA ISV1=OUSZ NON YO ‘SUOUUT ON JI 0 
a ATIVNId TIM ‘(Lad SOLS SSVW HO) LIuMaW/avauaW 

ONITIVD 3YOdaa 0 OL LESTYd AI ‘SMHL - SHNDDO0 HOUT ON AI 
GHONVHOND SNIVW3Y (YYFOI) GYOM SIHL */WOOLI4/NOWWOD 40 

YOM GNOOSS NI GaNUNLSY YV ‘YNI00 ABHL AI *SHONNA O/T 


'2aLON 


a 
. *(SOMDVW NEdO L LLY YO WLIXSH SNOANT “3I) /WODLAA/NOWWOD 40 
8 GYOM LSYId NI USSHON TSNNVHD LLLY YO SSEXGGY ada WILXSE 
5 HLIM GNVY SSODV SLIUM/aVEY YOR NEdO ATAFdOYd BE LSOW BIIa : 1SLON 
is} (MOwYT WON TENNVHD | LH) BYIOI*NVHOI/WODLAA/NOWWOD YO 
(dowaa ‘ssaudav gaa {1xXSH) wYSOr' aaal/WOOLaa/NOWWOD 
SENIVA "IVEY HN ‘SYOLS SSVW OL Vand WOYd ‘AC XSGNI ‘NOT ALIUM 9! 
SGN IVA IVEY GN ‘VANE OL SYOLS SSVW WOUd ‘HC XZGNI ‘NOTE vay d! 
(gce*aN‘vang)iIuMaW aNIZQO¥aNS 
(ge*aN'vang)avauaN aNIZQOwENS 
Udd YOd SENILNOY O/T OYVW LSVA LILY YO WLLXSY LLaad 
LIWMaW ‘GVaYaN :SNILNOUENS 
ana 
40Ls 
(pI ‘wuar ‘HO + 
*LOSMYOD /LNIAW/ TIV LON H¥Z ‘HO TIVWS OOL GdOuOd XBAI HSZ) LYWHOd 7666 
WMG (766641) BLTUM EL 
2 
dons 
FY 
Wald = OW4IG (OW4IG*LO"WAIG) aT 
(ST€ “= ()VKEH HOL ‘EI + 
‘= aval H@ ‘€I ‘= XSOI HB ‘EI ‘= XEGI HB ‘EI ‘= UIGI HB + 
‘eI ‘= NOSI H@ ‘€I ‘= WIGN H@ ‘XL ‘P"Liad * adId XWW HOL) LYWYOd 666 
(WIGN' L=o'(L)¥XaW) ‘XVaT *XOI + 
‘X9AI ‘MIGI ‘NOSI ‘WIGN ‘Wd4IG (€666'd1) BLIMM (0°SO"LNIWAI) aT 
2 
(aWV¥ IVILINI SV BWVS 3d GINOHS) SLINSTY SSHANI LNIUd O 
a 
SONILNOD 021 
BONILNOD = OLL 
ONIA + O1VA = N1VA 
((preLa ‘xz)€ *st *XL) avWuod 1666 
41d ‘O1VA ‘WH ‘I (666'aT) SLIYM (0° LOLNTUAI) aT 
41d = Wald (WaIG"LO*d4IG) at 
(o1vA-Wa) Sav = aIa 
((1) Vana) Ivau = WH (0°OR*aWYI) aI 
(1)vang = Wa (0°3N"aWYI) aT 
ANON‘ L=I 01} Oa 
2 
US SSVW NVULYOd NI SV NEUN‘NALN dO GVLSNI SUH LGYN‘LGLN 3S NVD OS 9 
HLONG'I INEWI4aTG 40 ,SGYOOTU, LATOOV NVO LIMMAW/GVSYAN ,OYOVN, “LON) 2 
(YvaaW AG GELNAWOOTY) LGLN ONTIVLOL ‘HLONTT LGUN dO ,SGDau, avay 2 
2 
é (ge ‘LUN ‘vang)avayaN TIVO 
3 LGLN'L=ar zt oa 
"0 = O1VA 
3 “0 = wala 
a 2 
E LOANI WOONVA ‘IVILINI HLIM LINSHY SSHBANI Lad SFYVaWOD “MOTEE D 
2 
i (X1aWo HO ‘Ivda ‘NEWIG ,LSYIa, NI SLWIG 40 YASWON SI LNON) 2 
NAWIG ,JSUIa, NI STVSY 1GYN dO @WNN TVLOL 1GIN ‘NLOO¥ ¥ad7aH O 


2 
Z/UNON = LNON (0°OS"aWHI) aT 
GUN = INON 
O€L OL OD (O°SN"wuaI) aT 
(O*aWHI)YvddW = WUsI OOL 
B) 
(4aIGHb ‘XOL ‘IONIHS ‘X9 ‘We*Z/LadHe ‘Xb ‘XSGNI HS) LYWYOS S666 
(S666'd1) 3LIEM 
(WIGN* L=£* (2) ¥x3H) * 
‘aVdI ‘X3OI ‘XSI ‘WIGI ‘NDSI ‘WIGN (8666‘d1) SIUM 
aWaI ‘INIWdI (666641) SLIUM 
2 
LNdLNO LS3L xd SONIGVEH LNIYa ‘MOTEE O 
2 
0OL OL OD (O°R1LNIUAI) aT 
5 
AVHUY SWHO4SNVYL 3SUBANI LddWO SNILNOU ¥O 9 
E) 
(xgor ‘xger + 
‘vad *1VOS “MIGI ‘NOSI ‘WIGN ‘VX3W)%ddWD TIVD (0°OS'AWUI) aT 
2 
‘Ivau GaNOVd OL AVUUY SWHOASNVYL SSUSANI LadWY INILNOW USHLIA O 
Bo) 
(4vdI ‘xSOI *xaeI* 
‘vand ‘IVOS ‘MIGI ‘NOSI ‘WIGN ‘VX3W)JdaWY T1VD (0°SN'4WYI) aI 
azIs/"| = Ios 
uIGI- = ¥IGI 
NOSI- = NOSI 06 
2 
(TVa¥-OL-Xa1dNOD) WHOASNVYL JSYBANI YOd MIGI GNV NOSI LYAANI ‘MOTE O 
2 
SONILNOD 08 
SONIINOD = 0L 
(preLaz "Xz “ST XL) Lvwuod 9666 
(1)VaN@) ‘XSQNI (9666'd1) 3LTEM 
04 OL OD (O°ST"ANINdI) aT 
t - £ = XgaNr 
INON'L=I 04 OG 
2 


LS SSYW NVYLUOd NI SV X@UN'NALN JO GVLSNI 3YSH LGUN'LGLN 3SN NVO OS 2 


HLONS' INAUSddIG 40 ,SGHODTU, LdFOOV NVO LIMMAW/GVEYAW ,ONOVW, ‘GLON) 9 
(GvddW AG GFLN4WOOTH) LGLN ONIIVLOL ‘HLONSI LGUN gO ,Sdogu, avau 2 
Q 

(ge ‘LGUN *van@)avauan TIVO 

GNON* (1-G£) = 4 

IGIN‘L=ar 08 oa 

PF) 
4I ‘NOSIMVAaWOD WHOd GNY) LINSAY XaTdWOD Lad SSAOOV NVO WYHOOWd ‘MOTEE O 
EI} 


(SIWId LNON ‘SLVLS Xa1dWOD NI VAVd YOd 1+=dWHI LON) 2 
NEWIG ,LSHId, NI S1Va¥ GUN dO GWON TVLOL LGLN ‘NIMOY HadTaH O 


B) 
Z/LGuN = LNON 
O€L OL OD (O°SN"WNST) aT 
(0° aWaI-)avddW = wuaT 
=) 
(GaaHe ‘XZL *XSGNI 8) LYWHOd L666 
(L666‘d1) SL1uM 


(SI€ ‘= ()VXSW HOL ‘EI ‘= HvaI He ‘EI ‘= XSOI HB ‘EI ‘=HL * 

“ X9GI HL ‘€I ‘= UIGI HB ‘EI ‘= NOSI HB ‘EI ‘= WIGN H8) LYWHOd 8666 
(WTGN' L=c* (¢) vxaW) * 
‘NOSI “WIGN (8666'd1) SLIYM 
aWHI “INIWdI (6666'd1) SLIUM 


*avdI ‘XSI ‘XaaI ‘urar 
3 


INd4LNO LSaL YOd SONTGVEH LNIYd ‘MOISE D 


1.5-38 


MSFFT 


Section 1.5 


(OWSZ NON SXVH OL) | + 3d0D HOWS GIOH! 


Logs‘ LNOGM‘ ana‘ NVHO' vauv! 


su sv 


LY gO NO MOTd SGTOH OH! ow 4ou 

GU OL ONIGHOODY LHDIU O¥/LU aTVOS! res 4Ou 
210 awe 
(SYOLOES LYvd) 9SZ°LT'GMN 4O ONITGNVH X3TdWOD SHOW *MOTSE * 

oang* 
SN SOMOVW O/I {14 wOd vauv! OL swig’ = :vauv 

v1 ua 
LOgS* LNOGM‘ 4ng* NVHO* vauV La‘cued* pa vauve = MLTEM" is7 
oa Sie “1 

/WOILAA/NOWWOD NI HUSOI NI! waaOI' pu AOW 


€'Z*L OL OD Z*L*O SHOwUs! as ONI 
pu'LamMaa = GAOW 


UVE1O AWYVD aI wOuNT ON! ut O08 v1 


ba*cu*eu' pal vauve Mavay~ 


@LIUM aI HONVUG! st 11a 
ormse ish 
US@WON ‘ISNNVHO=put vu‘ NVHOT AOK :LOONT 
LiGa YOd NOILOS IVNOTLIGNOD! 
xsu* aan are 
Oana" 
(daunawoo *¥aMo7 0 yom" ‘Logs 
(0 SAVMIV ‘H3HOIH) ZN1VA HOLES Sa70) 0 auom’ = :4oas 
v1 ua 
OWAT' LOTS LNOLAG' ANG‘ aad! LM LOaSe' Zu‘ eu pu SALIUM 17 
Da sun 141 
/MODLAd/NOWWOD NI WUGOT NI! wugOr* pa AOW 
gq09 YOuNa SAILVOIN GOH! vu’ (pu) mug’ AON 
ssaudav aqa=pu! vu‘ aaar AOW 
4VaIO AWYVO 4I HOUNT ON “1 208 


HSINI4 O/I ¥O4 LIVM! Latya | SLIVM 
OV1d “NEAT ¥Od NOI aso! tat (payNoTa aon 
ssaudav ada=put va‘ aaar AOW ie 


OAT LOIS LNOLAG ANG‘ aaa! LU'LogSse'Zu‘eu* pu = SavaN 


4SIX3 LON Sd0q aI avau ON “1 1a 

Ga SLSIXE YOLOIS 4I LSaL 11038‘ Ou awa 

WOLOGS UsqVaH HO4 MOTIV ou oaa 

40% dO HOLOGS MOT LED! O4' (pu) T+HBaa" a AOW 

SLIUM aI HONVUE! ST 1a 

ormse asa 

OVId LNSAT YOd NNT aso! but (payNoT-a gAOW 

ssauday aaa=pu! put daar AOW 

SN1VA WOLOSS YIMO1 SV GTOH! ‘TLoas* 1a AOW 

L HLIM SZ¥VLS HOLES WLLxsH! ta ONT 
beEN=LNOQOD SLAG SAIN WLLXSH! eu ‘Isy  :ZOONI 

WLLXSHY YOd NOILOSS IVNOILIGNOD 
xsu‘ag are 


LNdLNO/LNdNI LOFHIG ATaWIS 40 GNa * 
SNILNOWGNAS WOud NuNLaU! Bra Sia 197 
LNdLno/tndNI LOguIa TIvot LOONI ‘Oa usc TELT 


ALdWa SYOO1 4Nef FYNSNS “SLUM LOguIG! QTHOaS‘ L-# AOW 
elt oa 
SLIUM/avau 4Oa dn Las! 


OIMsr* msc AOW TLLT 


ssauqav vana=cu 
LNQOD GuOM=7¥ 


(O=LSuId) LUVLS HOLOES=14 SAVH MON 

out ua 
su usv 
SU OL DNIGHODOY LY aIVOS! 1a sv 
GNNO4 NSHM SLa71aWOo LY tL ana 

‘95% LY LIG WO XOOT! sut-oste 11a tOLT 

(Z 40 WaMOad GMN SAWOSSV) IaS4d0 HOLOTS OL Ly BIVOS ‘MOTE } 
(xa1aWOD SHOW) LON 4I 717 OL OD! Z47 oie 
SOLOS S'1OHM USHLEHM NOTH! toste'su aw 
“asddO GYOM YOa OY YVEIO! 0% aio 
OWaz INNOD dI HSINIG 91 ogg 
SY OL Add suey AOW 
TeGN ‘LNNOD GYOM=7H eu sv 
tare! et oga 

SINAWNOUY ANTLNOENS ONISSOOV HSINIG 

80,1 Lat+ (Su) a AOW 
/AN,=7a? cu*+ (SHS AOW 
.vana, 40 ssaucav=-cu! eu'+ (Su) AOW 
INNO LNAWNDYV aYONST! +(Su) as 

‘MSC QOH! asctou AOW rt 

l-=MSc SLaS LIuMaW! Ou L-# AOW :.LTUMaW 
1 ua 

t=mse sigs avauaw! out Le AOW = :avauaw 


LIMMAW'avauaW ‘18019* 


oana* 
MAO‘ TaY* IOI I‘MyavaydW Loasd* 
(dOW¥a ON 4I GEONVHONN) OV1d HoOuNa! 0 GuOM’ = :Huaor 
MaGWON "TANNVH: 0 G4yOM' iNVHOT 
YAO Iau TED‘ a*MYWOOLdd §=LOaSd* 
tS=LAewUa 
MLTUM**Mavau" ‘TIVOW' 
(Ligdjavauan a1LTL" 
(€A) Lia YOa NOILOaS IVNOTLIGNOD 


xsu‘ dan ar’ 

oana* 

Logsd* 
(8O¥4a ON dT GHONVHONN) OVTd YOUNa 0 qGuoM' ‘wugor 
ssaudav aaa 0 quom* ECESs 


AO IaH TEO‘a'MY*WOOLdd LOTSA” 
SLIVM'$3LIUM‘$avay ‘TIVOW* 
(WLLXSY)avauaW ATLL" 

(€A) WLLXSY YOd NOTLOAS IVNOILIGNOD * 
xsu‘ag ar’ 


o=xsu 
NI‘ ONIMOTION 3SVHS ‘LLL HOd “WLLXSH HO ATAWASSV OL AGVY ‘PALON! 


‘(daVS LOG MOIS ‘3114 OL HOLOGS SIHL SHLIUM SAVMIV 3LIUM 
!WOLOIS GIOH OL aac GYOM 9Sz ‘IVDO1 SaSN $9°a1"EN) 
IN@IOIdaa LSOW SHOW HO BZL 'Z dO YSMOd TVHOTINI NV 3G LSOW EN 


‘01 


15-39 


Chapter 1 


FFT Programs 


ang” 
9S7°LT"GMN YOd WAddNG TVOT GHOM 9Sz anar: ‘ost mua’ = sana 
anaf NI Gdavo1 woLoas INawuNd! t- ayom* :a1HOas 
SNILNOY LOONI ¥Od GESN MSE IVOLOV! 0 auom: :orMse 
LIMMaW L- ‘GVaY¥aW L+=MSct 0 quom* MSL 
SHIGVIUVA IVOO1 ‘MoTaG ¢ 

oa Suu 

ou'+(ds) AOW 

Lat+(as) AOW 

tu*+(ds) AOW 

€4 OL 04 SUaLSIOGY aYOLSaU! €u'+(as) AOW 

SNILNO¥ LOONI ‘TIVO! use 

ssauaay an@f Iv01 SI ex! AOW 

MOLOES AIOHM HOA *9S7=Zu! AOW 

AOW 

AOW 

AOW 
€¥ OL OW SUsISIOgY BAYS! AOW :LOONIT 


SNILNOW LNALNO/LNANI IVDO1 ‘MoTaa + 


e1 ua 
aN@f OL avau 1VOO1 oa! LOONIT' Od usc 
avau uoa an Las! OIMSL* L# AOW 
WON HOLOSS LN@YUND C'IOH! aTHOas* La AOW ==: 82 
@1@Issod 41 ‘aN@f TVOOT avol ‘moTga + 
HSINIA! 91 awe 
(gavS 498 MOIS) aN@e IV901 Wows TLTUM! LOONIT‘ Od use 
ALIMM ¥O4 O/I df Last OIMSC' L-# AOW 
oa 
oad 
4N@ IVOO1 OL wasn xd0d! AOW = 627 
MOLOMS MVa ,aLTUM, ‘MOTaE ¢ 
HSINTIA! 91 awe 
ee7 woa 
a oaa 
vana WaSN OL TVOOT Ad00? + (eu) *+ (0m) AOW = :22T 
MOLOSS Uva ,avau, ‘MoTaa ! 
€e1 wie 
SLIUM/GVaU USHLEHM LSA! asc isa tLe 
OaN AI p21 LY OLOES avOT LSuIa so! ve ana 
agqvoT YOL93S LNaYYND AaHO! tu‘ aiHoas aw 
Lasad0 + ssa¥aav aner=out ou‘ anace aav 
ugaan@ WISN GNY TVOO1 NASMLaa HaaSNVEL ‘MOTaE ¢ 
ssauddv vana wasn=eu 
INN09 GUOM=7¥ $ 
GguINOaY WOLTS= 14 
4addNd IVOOT NI LasddO 3LAG=04 SAVH MON 
ou asv 
ou oavMS = :02T 
za ua 
aNnod 4I aLaTaWOO O4/ LE! 027 ana 


9S% LIG HO XOOT! sutcost# aia 


1.5-40 


1.6 


Chirp z-Transform Algorithm Program 


L. R. Rabiner 


Acoustics Research Dept. 
Bell Laboratories 
Murray Hill, NJ 07974 


1. Purpose 

This program can be used to numerically evaluate the =transform of a sequence along a circular or 
spiral contour beginning at any arbitrary point in the z-plane. 

2. Method 


The program is an implementation of the chirp transform algorithm of Rabiner, Schafer, and Rader 
[1]. If we call the input sequence x(n), defined for 0 < n < N—1, then the ztransform of x(n), 
evaluated along the contour z = AW" (with parameter a) at the set of points 


%= AW k=0,1,..,.M—1 () 
is 
=I 
X(%) =X, = Y x(n)a-"w (2) 
n=0 


This program provides a computationally efficient algorithm for evaluating Eq. (2) at the set of M- 
points given by Eq. (1) by implementing it as a discrete convolution [1]. 


The general contour of Eq. (1) is that of a spiral in the zplane. This is more clearly seen if we let the 
complex constants A and W be expressed in the form 


Aim agel™ (3) 
W = Wye?" (4) 


As shown in Figure 1, the general z-plane contour begins with the point z = A and, depending on the 
value of W, spirals in or out with respect to the origin. If W = 1, the contour is an arc of a circle. 
The angular spacing of the samples is 279. The equivalent s-plane contour with s = (In z)/T begins 
with the point 


S0= 79+ jao= In A (5) 
and the general point on the s-plane contour is 
= 50+ k(Aotjdo) = + din A-kin W) OS KS M—1 (6) 


Since A and Ware arbitrary complex numbers we see that the points s, lie on an arbitrary straight line 
segment of arbitrary length and sampling density. 

3. Program Description 

3.1 Usage 


The program consists of the CZT subroutine, two associated subroutines (RECUR and DECUR), and 
an FFT subroutine (FFT842). The user passes the data sequence and all the parameters required to 
specify the contour and the appropriate transform sizes for processing, and the subroutine returns the 
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z-plane 


(a) 


1 
4 

ai : 
Jou kM Ag 


Fig. 1 An illustration of the independentent parameters of the CZT algorithm. (a) How the z-transform is evaluated on a 
spiral contour starting at the point z = 4. (b) The corresponding straight line contour and independent parameters in 
the S-plane. 


ztransform of the sequence in the same array in which the input sequence was passed. The FFT sub- 
routine is a radix 2 complex input FFT [2]. As such the CZT routine requires that all relevant FFT’s 
are for sequences whose length is a power of 2. 


3.2 Description of Parameters of CZT Subroutine 


The basic call to the CZT subroutine is of the form 
CALL CZT (XR, XI, NDATA, NOPTS, DLTSIG, DLTOMG, WTR, WTI, SIGO, OME, NTR, NFFT, FS) 
where 


XR Array of size NFFT. On input XR contains the real part of the input data (Relx()]); on 
output XR contains the real part of the transform (Re[X;]). 


XI Array of size NFFT. On input XI contains the imaginary part of the input data 
(Im [x (n)]); on output XI contains the imaginary part of the transform (Im[X;]). 


NDATA The number of points in the input sequence (N). 

NOPTS The number of points in the output sequence (M). 

DLTSIG Increment in sigma along the CZT contour in Hz. (DLTSIG = Ao/2z in Figure 1). 
DLTOMG Increment in omega along the CZT contour in Hz. (DLTOMG = Aw/2z in Figure 1). 
WIR Array of size NFFT which holds the real part of the transform of W-”"/”), 
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WII Array of size NFFT which holds the imaginary part of the transform of W“""/2), 

sIGO Initial value of o of CZT contour in Hz. (SIGO = o/27 in Figure 1). 

OME Initial value of w of CZT contour in Hz. (OME = w)/2z in Figure 1). 

NTR Rotation factor on input data to make input appear to begin at n = —NTR instead of n = 


0. (Set NTR = 0 to avoid using this option.) 


NFFT Size of FFT performed internally in CZT subroutine. NFFT is a power of 2 that is not less 
than (NDATA+NOPTS-1). 


FS Sampling frequency of data in Hz. 
FFT842 FFT subroutine with calling sequence CALL FFT842(IT, NFFT,XR,XI) where 
IT = 0 for direct FFT 


= 1 for inverse FFT 
NFFT = Size of FFT 
XR = Array of length NFFT - real part of data 
XI = Array of length NFFT - imaginary part of data 


3.3 Dimension Requirements 


The DIMENSION statement in the calling program should be modified according to the requirements 
of each particular problem. The required dimensions of the arrays are 


XR must be a power of 2 no less than NDATA + NOPTS —1 
XI same as XR 
WTR same as XR 
WTI same as XR 


3.4 Summary of User Requirements 


(1) Specify input sequences XR and XI, and parameters NDATA, NOPTS, DLTSIG, DLTOMG, 
SIGO, OME, NTR, NFFT, FS and supply FFT routine FFT842. 


(2) Call CZT. 
(3) Output is obtained in arrays XR and XI. 


4. Test Problem 


Compute the z-transform of a delayed impulse along any CZT contour. The test program (See appen- 
dix) accepts as input from the teletype the CZT parameters NDATA, NOPTS, FS, SIGO, OMEO, 
DLTSIG, and DLTOMG, as well as the delay parameter IDEL to form the sequence 
x(n)=1  n=IDEL 
=0 otherwise 


The test program prints the input information, determines the FFT size, and prints the real and ima- 
ginary parts of the transform of the sequence. 


The subroutines CZT, RECUR and DECUR are given in the appendix. Tables 1-4 give outputs of the 
test program for 4 test runs. Figures 2-5 show plots of the output sequences (both real and imaginary 
parts) for these test runs. The parameters used in these runs are printed in Tables 1-4. 
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Fig. 2 Output sequences for the input signal x(n) =1, n= 1 and x(n) =0 for all other n, evaluated on the contour 
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Fig. 4 Output sequences for the input signal x(n) =1, 1 =4, and x(n) =0 for all other n, evaluated on the contour 
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Fig. 5 Output sequences for the same input as Fig. 4, evaluated on the contour z = ¢ 1° ¢ 100 @-4/1000 & = 0,1,,,.,99. 
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Table 1 


NO OF DATA POINTS= 100 

NO OF OUTPUT POINTS= 100 
DELAYED IMPULSE AT SAMPLE NO= | 
SAMPLING FREQUENCY= 10000.000 


INITIAL VALUE OF SIGMA= -000 
INITIAL VALUE OF OMEGA= +000 
INCREMENT IN SIGMA ALONG CZT PATH= 000 


INCREMENT IN OMEGA ALONG CZT PATH= 100.000 
REAL PART OF OUTPUT SEQUENCE 


-99996E 00 «99804E 00 +99207E 00 
+95102E 00 +92971E 00 +90479E 00 
+80895E 00 -77048E 00 + 72889E 00 
+58777E 00 +53579E 00 -48173E 00 
-30899E 00 +24869E 00 +18736E 00 
-.50576E-05 - .62791E-01 -.12531E 00 
-.30901E 00 -.36810E 00 --42576E 00 
-.58779E 00 --63741E 00 ~-68454E 00 
~.80895E 00 -.84428E 00 --87622E 00 


-.95097E 00 --96852E 00 --98225E 00 


-.99994E 00 -.99796E 00 -.99205E 00 
-.95101E 00 -92968E 00 -90479E 00 
--80894E 00 +77050E 00 «72888E 00 
-.58777E 00 -53580E 00 +48173E 00 
-.30900E 00 -.24868E 00 ~.18736E 00 
-.17870E-04 -62786E-01 +12533E 00 
«30901E 00 -36811E 00 -42574E 00 
-58775E 00 +63739E 00 »68450E 00 
+80895E 00 -84426E 00 +87620E 00 
+95097E 00 +96854E 00 .98226E 00 
IMAGINARY PART OF OUTPUT SEQUENCE 
-.12159E-04 --62797E-01 ~.12532E 00 
-30900E 00 +36810E 00 +42575E 00 


-58777E 00 
~-80894E 00 


63742E 00 
-84426E 00 


68451E 00 
+87624E 00 


-95097E 00 -~96853E 00 98224E 00 
+99997E 00 -99796E 00 +-99205E 00 
-95099E 00 92967E 00 -.90477E 00 
-80898E 00 +77048E 00 72892E 00 
-58776E 00 53582E 00 48172E 00 
-.30900E 00 24868E 00 18735E 00 
-.57220E-05 +62794E-01 .12531E 00 
»30902E 00 +36810E 00 «42573E 00 
-58774E 00 »63740E 00 -68450E 00 
-80899E 00 +84426E 00 ~87627E 00 
~95098E 00 -96855E 00 +98224E 00 
+99994E 00 +99797E 00 +99208E 00 
+95100E 00 -92972E 00 -90477E 00 
-80895E 00 +77049E 00 +72891E 00 
.58775E 00 ~53578E 00 -48171E 00 
«30898E 00 +24867E 00 -18735E 00 
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~98224E 
.87627E 
»68450E 
+42575E 
+12529E 
«18733E 
-48173E 
+72891E 
~90478E 
+99207E 
-98220E 
+-87625E 
-68448E 
»42573E 
+12532E 
+18734E 
»48172E 
+72891E 
«90476E 
+99207E 


+18734E 


+12530E 


00 
00 
00 
00 
oo 
00 
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-96854E 00 
-84426E 00 
+63739E 00 
-36811E 00 
-62772E-01 
~.24863E 00 
-53580E 00 
+77045E 00 
+92974E 00 
-.99798E 00 
-96853E 00 
+84426E 00 
63740E 00 
-36810E 00 
--62778E-01 
-24866E 00 
-53580E 00 
+77047E 00 
+92973E 00 
+99799E 00 


-.24865E 00 
53582E 00 
-.77043E 00 
92975E 00 
99795E 00 
96854E 00 
84427E 00 
63740E 00 
36808E 00 
62774E-01 
«24864E 00 
-53580E 00 
«77046E 00 
+92974E 00 
-99796E 00 
-96853E 00 
-84424E 00 
»63741E 00 
+36807E 00 
-62779E-01 
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NO OF DATA POINTS= 100 
NO OF OUTPUT POINTS= 100 


DELAYED IMPULSE AT SAMPLE NO= 
SAMPLING FREQUENCY= 10000.000 


INITIAL VALUE OF SIGMA= 


Table 2 


1 


+000 


INITIAL VALUE OF OMEGA= 1000.000 
INCREMENT IN SIGMA ALONG CZT PATH= 
INCREMENT IN OMEGA ALONG CZT PATH= 


REAL PART OF OUTPUT SEQUENCE 


-80899E 00 -80530E 00 
-79014E 00 «78624E 00 
«77048E 00 -76648E 00 
+75010E 00 -74593E 00 
«72893E 00 «72463E 00 
«70711E 00 +70261E 00 
+68448E 00 -67993E 00 
.66129E 00 -65654E 00 
+63737E 00 -63254E 00 
+61286E 00 -60789E 00 
.58776E 00 -58266E 00 


+56207E 00 .55684E 00 
.«53576E 00 .53046E 00 
»50903E 00 .50360E 00 
+48172E 00 -47622E 00 
.45396E 00 +44835E 00 
+42578E 00 -42007E 00 
+39713E 00 +39136E 00 
.36809E 00 +36224E 00 
~33874E 00 +33278E 00 
IMAGINARY PART OF OUTPUT 
-.59286E 
.61782E 
+64222E 
+66597E 
-68910E 
«71151E 
+73320E 
»75421E 
+ 77448E 


-.79011E 00 
-.80899E 00 
-.82702E 00 
~.84425E 00 
-.86072E 00 
-.87624E 00 
-.89094E 00 
-.90477E 00 -.90746E 00 
-.91769E 00 -.92015E 00 
-.92970E 00 -.93198E 00 
-.94078E 00 -.94292E 00 


»80154E 
»78237E 
+ 76239E 
~74176E 
+72026E 
~69814E 
~67529E 
-65181E 
-62765E 
-60291E 
.57752E 
»55161E 
~52514E 
»49817E 
«47066E 
.44272E 
~41433E 
.38558E 
»35637E 
.32685E 


-.89657E 
-.91007E 
92261E 
93422E 
-.94501E 
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«000 
10.000 


+79779E 
.77843E 
+75833E 
+73750E 
+71593E 
~69359E 
~67067E 
~64701E 
+62275E 
.59789E 
.57240E 
-54633E 
«51981E 
+49270E 
»46512E 
»43709E 
»40861E 
.37976E 
»35051E 
-32091E 


-.60291E 


88519E 
9932E 
91264E 
92500E 
93644E 
-.94702E 


+ 79396E 
+ 77450E 
«75420E 
.73326E 
.71152E 
-68907E 
»66596E 
+64222E 
.61780E 
.59285E 
.56723E 
.54106E 
»51442E 
.48723E 
.45954E 
+43145E 
.40287E 
.37393E 
.34463E 
+31496E 


-.60790E 


93862E 
-.94901E 
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Table 3 


NO OF DATA POINTS= 100 

NO OF OUTPUT POINTS= 100 
DELAYED IMPULSE AT SAMPLE NO= 4 
SAMPLING FREQUENCY= 10000.000 


INITIAL VALUE OF SIGMA= 000 
INITIAL VALUE OF OMEGA= -000 
INCREMENT IN SIGMA ALONG CZT PATH= +000 


INCREMENT IN OMEGA ALONG CZT PATH= 100.000 
REAL PART OF OUTPUT SEQUENCE 


-99998E 00 +96855E 00 +87630E 00 +72893E 00 -53583E 00 
+30901E 00 -62805E-01 --18737E 00 --42578E 00 --63738E 00 
-.80899E 00 --92975E 00 -.99206E 00 -.99205E 00 --92975E 00 
~-80894E 00 ~-63739E 00 -+42578E 00 -.18739E 00 -62804E-01 
+30900E 00 +53579E 00 -72896E 00 +87624E 00 + 96854E 00 
-99997E 00 +-96853E 00 -87624E 00 +72895E 00 -53580E 00 
+30900E 00 «»62806E-01 ~.18736E 00 -.42577E 00 ~-63741E 00 
--80897E 00 -.92976E 00 ~-.99206E 00 -+99209E 00 ~+92975E 00 
-.80899E 00 --63739E 00 -.42578E 00 -,18738E 00 «62791E-01 
+30899E 00 »53581E 00 +72895E 00 -87627E 00 ~96853E 00 
+99998E 00 +96853E 00 -87627E 00 »72894E 00 «53579E 00 
+30900E 00 «62789E-01 --+18735E 00 ~-42580E 00 --63737E 00 
~.80896E 00 -.92974E 00 -.-99204E 00 --99203E 00 --92977E 00 
~-80898E 00 -.63740E 00 -.42577E 00 -.18737E 00 «62795E-01 
+30902E 00 «53581E 00 +72895E 00 -87625E 00 ~96856E 00 
+99995E 00 -96855E 00 -87626E 00 +72895E 00 «53580E 00 
+30899E 00 +62789E-01 -+18738E 00 --42577E 00 --63740E 00 
-.80896E 00 -.92975E 00 ~-99203E 00 -.99205E 00 --92975E 00 
~-80897E 00 -.63737E 00 -.42579E 00 -+18737E 00 +62807E-01 
+30898E 00 -53582E 00 +72895E 00 -87628E 00 ~96854E 00 
IMAGINARY PART OF OUTPUT SEQUENCE 
-.17881E-05 -.24868E 00 ~.48173E 00 --68453E 00 --84434E 00 
-.95103E 00 -+-99799E 00 ~.98225E 00 -.90481E 00 --77047E 00 
-.58778E 00 ~.36811E 00 -.12530E 00 -12533E 00 +36811E 00 
«58775E 00 +77050E 00 +90477E 00 +98225E 00 +99797E 00 
+95101E 00 +84428E 00 +-68453E 00 +48172E 00 «24869E 00 
«54791E-06 -.24870E 00 --48172E 00 - -68453E 00 ~.84428E 00 
-.95100E 00 -.99792E 00 -.98227E 00 -.90479E 00 -+77048E 00 
-.58776E 00 -.36813E 00 -.12532E 00 +12534E 00 +36811E 00 
«58778E 00 +77047E 00 »90478E 00 +98223E 00 +99800E 00 
+95099E 00 »84430E 00 +68450E 00 +48173E 00 +24868E 00 
-.80466E-05 -.24869E 00 ~.48173E 00 -.68450E 00 84428E 00 
-.95100E 00 -.99797E 00 +98225E 00 --90480E 00 77043E 00 
-.58778E 00 --36810E 00 ~.12531E 00 +12532E 00 +36811E 00 
»58776E 00 +77049E 00 +98228E 00 +99798E 00 


+95103E 00 «84427E 00 +48172E 00 +24868E 00 


-63641E-05 ~.24868E 00 »68449E 00 
+95104E 00 +99796E 00 90478E 00 
~58776E 00 -.36813E 00 +12532E 00 +36809E 00 
.58775E 00 +77045E 00 «98222E 00 +99796E 00 
+95096E 00 +84429E 00 -68452E 00 +48174E 00 +24867E 00 
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Table 4 


NO OF DATA POINTS= 100 

NO OF OUTPUT POINTS= 100 

DELAYED IMPULSE AT SAMPLE NO= 4 

SAMPLING FREQUENCY= 10000.000 

INITIAL VALUE OF SIGMA= 000 

INITIAL VALUE OF OMEGA= 1000.000 

INCREMENT IN SIGMA ALONG CZ2T PATH= 1.000 
INCREMENT IN OMEGA ALONG CZT PATH= 10.000 
REAL PART OF OUTPUT SEQUENCE 


00 --82454E 00 --83963E 00 

00 -.89484E 00 90730E 00 

00 -.95174E 00 96147E 00 

00 ~-99431E 00 10010E 01 

01 10251E 01 

01 10331E 01 

01 10250E 01 

01 10003E 01 

00 95939E 00 

00 90270E 00 

00 83102E 00 

00 74511E 00 

00 64630E 00 

00 53599E 00 

00 -41573E 00 

00 -.28731E 00 

00 -.15279E 00 

~ -69821E-01 -.41955E-01 -.13989E-01 
+» 70276E-01 + 98476E-01 »12674E 00 
+21112E 00 +23918E 00 +26715E 00 

IMAGINARY PART OF OUTPUT SEQUENCE 

-.58779E 00 -.56797E 00 -.54777E 00 
-.48477E 00 -.46306E 00 --44096E 00 
-.37278E 00 -.34942E 00 -.32581E 00 
~-25341E 00 ~+22882E 00 ~.20401E 00 
-.12852E 00 -.10304E 00 ~.77441E-01 
-64782E-05 +25956E-01 -51970E-01 
+13014E 00 -15618E 00 +18220E 00 
«25987E 00 +28559E 00 «31117E 00 
-~38710E 00 +41204E 00 .43682E 00 
.50974E 00 -53357E 00 .55708E 00 
»62587E 00 -64813E 00 .67007E 00 
+73351E 00 +75385E 00 +77374E 00 
»83084E 00 ~84888E 00 .86647E 00 
+91614E 00 +93165E 00 ,94657E 00 
«98799E 00 .10006E 01 +10126E 01 
+10450E 01 +10545E 01 +10634E 01 
«10861E 01 +10923E 01 +10979E 01 
+11105E 01 «11133E 01 +11153E 01 
+11175E 01 +11168E 01 +11154E 01 
+11067E 01 +11025E 01 .10975E 01 


-85418E 00 
+91930E 00 
+97053E 00 
+-10071E 01 
+10280E 01 
+10328E 01 
+-10213E 01 
+99339E 00 
-94927E 00 
+88957E 00 
+-81492E 00 
+72637E 00 
+62509E 00 
«51267E 00 
+39062E 00 
.26084E 00 
+12531E 00 
+14026E-01 
+15491E 00 
+29500E 00 


»52714E 00 
.41856E 00 
»30191E 00 
+17903E 00 
»51717E-01 
+» 78026E-01 
.»20816E 00 
-33663E 00 
-46136E 00 
+58035E 00 
~69160E 00 
«79323E 00 
.88351E 00 
«96098E 00 
+10240E 01 
+10716E 01 
+11028E 01 
+11168E 01 
+11132E 01 
-10919E 01 


-.86828E 00 
93065E 00 
--97907E 00 
-.10125E 01 
-.10303E 01 
--10318E 01 
-.10170E 01 
--98582E 00 
-.93859E 00 
-.87579E 00 
-.79828E 00 
-.70707E 00 
~.60350E 00 
-.48897E 00 
-.36525E 00 
~.23413E 00 
-.97641E-01 

+42120E-01 

«18306E 00 

+32278E 00 


-.50616E 00 
-.39581E 00 
-.27779E 00 
-.15386E 00 
-.25894E-01 
+10409E 00 
+23405E 00 
+36194E 00 
-48570E 00 
+60325E 00 
.71276E 00 
+81225E 00 
+»90015E 00 
-97477E 00 
+10348E 01 
+10792E 01 
+11070E 01 
+11175E 01 
+11103E 01 
«10855E 01 
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Complex General-N Winograd Fourier 
Transform Algorithm (WFTA)* 


J. H. McClellan 
HH. Nawab 


Department of EECS 
Mass. Inst. of Technology 
Cambridge, MA 02139 


1. Purpose 


This program computes the discrete Fourier transform (DFT) of sequences whose length N is a pro- 
duct of relatively prime factors taken from the set {2,3,4,5,7,8,9,16}. The method used in this program 
for computing the DFT is a general-N implementation of Winograd’s algorithm [1], referred to as the 


WFTA [2]. 


2. Method 


In order to set up a common notational framework we first summarize the basic form of the WFTA. 
Consider the computation of the N-point DFT of the sequence x[n], n = 0,1,...,N — 1. Suppose the 
transform length factors into the product of y mutually prime integers, N = N, x N,x-+: x N,,. 
The WFTA seria of five steps as illustrated in Fig. 1 for the case N = 15 


af es 
= AMEE Me a 
NES 


PERMUTATION 


cee 


2-POINT 3:POINT 
PRE-WEAVE betty ae 
MODULE 5-POINT 5:POINT MooULt 
PRE WEAVE MULTIPLICATION pOST.WEAVE 
MODULE PHASE MODULE 


(6 X 3 = 18 mults) 


Fig. 1 Fifteen-point DFT algorithm decomposed using Good’s mapping to obtain a two- 
dimensional (3x5)-point DFT and Winograd’s algorithms for 3-point and 5-point DFTs. 
The algorithm requires 18=6x3 multiplications which are "nested" between the pre-weave 


and post-weave modules. 
Step 1 The one-dimensional sequence x[n] is mapped into a y.-dimensional array s[n),n2,....2,) via 


the Sino correspondence [3,4] 
n= <B[¥]n> 9. o) 


* An earlier version of this program can be found in Ref. [4]. 
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where <->, denotes residue reduction modulo N. 


Step 2 The pre-weave [6] modules are implemented, one for each factor N,. Each pre-weave 
module contains only additions and subtractions. The size of the data array will expand, in general, 
when passing through the pre-weave elements. 


Step 3 The data array is multiplied (point-by-point) by an array of real constants} derived from the 
multipliers of the small-N DFT algorithms for N,, i = 1,2,...,4. These constants depend solely on the 
complex exponentials of the DFT, Wy, and are the only multiplications required in the algorithm. 


Step 4 The post-weave [6] modules are implemented for each of the « dimensions. Each of these 
modules contains only additions, subtractions and multiplications by j. A different module is required 
for each dimension. After passing through the post-weave section, the data array Slk kak) 
shrinks back to its original size, Nj x N,x---x N,. At this point in the computation we have 
obtained the -dimensional N; x Nx --- x N, DFT of the array s[m,3,....,]. 


Step 5 A mapping of the w-dimensional array S[k,,k2...,k,] is performed in accordance with the 
Chinese Remainder theorem to obtain the correct one-dimensional DFT, X[k]. This correspondence is 
given by [3,4] 


k = <s\k, + sok. + +-- +5,k,>y (2) 
where the integers s, satisfy 
$;=8, mod N, ; i,j =1,2,....p (3) 
2.1 Initialization 


In order to have an efficient WFTA program several computations need be performed only once 
when DFTs of the same length are to be calculated over and over. First of all, the factors of N must be 
determined. Since the WFTA is composed of small-N DFT algorithms that have only been developed 
for certain lengths, a check against the allowable factors of N is made. Next, the constant multiplier 
array is formed by multiplying together the pre-stored constants for the individual small-N factors. 
Finally, permutation vectors for the input and output mappings are prepared based on the factors of N. 
This speeds up the actual mapping process because the congruences (3) of the Chinese Remainder 
theorem are solved during initialization. The expense, of course, is the storage to hold the mapping 
vectors. 


3. Program Description 


The WFTA program consists of four subroutines, each of which will be described in the following. 
The flow of control in the algorithm is given in Fig. 2. Documentation of the individual computational 
modules (pre-weave and post-weave) is presented using the annotated flowgraphs of Figs. 3 through 10. 


The WFTA is invoked by calling the subroutine WFTA with the arguments 
N- transform length 
XR(N) - real part of array to be transformed 


XI(N) - imaginary part of array to be transformed. The real and imaginary parts of the transform are 
returned in XR and XI. 


INVRS - a flag to invoke the inverse transform. INVRS = 1 gives the inverse; INVRS = 1 gives the 
forward transform. A factor of N~' is included in the inverse. The inverse is actually 
obtained by modifying the permutation described in step 5 above to map to <—k>y instead 
of k. 


INIT - a flag to specify whether the call to WFTA requires initialization. INIT=0 calls for initializa- 
tion, INIT#0 skips the initialization phase. When many DFTs of the same length are to be 
performed, initialization is needed only for the first DFT but not on succeeding calls. See 
subroutine INISHL for details. 


+ Note that the constants are not allowed to be imaginary as proposed by others; rather the Post-weave modules contain 
“multiplications” by j to effectively obtain imaginary constants. Thus the need for a flag array is eliminated. 
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TERR - is an integer variable that contains, upon completion of a DFT, an error code. If the DFT 
was done successfully IERR=0; if an error occured IERR=—1 or —2. There are two causes of 
the error: (1) the transform length is illegal (i.e., it contains factors outside the set 
{2,3,4,5,7,8,9,16}), (IERR=—1), or (2) the program has not been initialized for the particular 
value of the transform length specified, (IERR=—2). 


The subroutine WFTA calls in turn the subroutines INISHL (if needed), WEAVE1, and WEAVE2. 
The permutations and multiplications are performed within subroutine WFTA. 


RETURN 
JERR =—1 


DETERMINE 
MULTIPLIER 
COEFFICIENTS 


DETERMINE. 
PERMUTATION 
VECTORS. 


SUBROUTINE WFTA 
MAP XRIN), XI(N) 

TO SAI }, Sil} 
VIA INDXT (N) 


IMPLEMENT PRE: 
WEAVE MODULES 


SUBROUTINE WFTA 


ND1*NO2*ND3°ND4 
MULTIPLICATIONS 


SUBROUTINE WEAVE? 
IMPLEMENT POST 
WEAVE MODULES 


SUBROUTINE WFTA 


MAP SRI), SIC) 
TO XRIN), XUN) 
VIA INDX2(N) 


Fig. 2. Flow of control in program WFTA. 
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Nl 
NBASE: ene 1.0 NBASE 
T1 1 SR2 
NARI INARI -15 NARI 
NR2: INR2 NR2 
~ a ; - 
3POINT PRE-WEAVE SPOINT POST-WEAVE 


Fig. 3 Three-point DFT algorithm using Winograd’s decomposition. Labels correspond to 
storage locations in FORTRAN program. 


Fig. 4 Four-point DFT which is also used entirely as a post-weave module in WFTA pro- 
gram. 


ONBASE 1.0 


~ 1.538841769 


0.5590169944 


0.363271264 


0.5877852523 


5-POINT PRE WEAVE 5-POINT POST-WEAVE 
Fig. 5 Five-point DFT algorithm using Winograd’s decomposition. 


The subroutine INISHL performs those calculations, for a fixed value of N, that need not be done 
on each pass of the algorithm. These include factoring the transform length N into its mutually prime 
factors, calculating the constant coefficients to be used in the multiplication step, and calculating the 
mapping vectors for the pre- and post-permutations of the data to be used in the input and output per- 
mutations. The transform length N is factored into mutually prime factors taken from the set 
{2,3,4,5,7,8,9,16}. Since N can have at most four factors from this set, the factors are assigned to the 
integer variables NA, NB, NC and ND as follows: 


NA is assigned the largest value from the set {1,2,4,8,16} that divides N; NB the largest divisor of N 
from the set {1,3,9}; NC the largest from {1,7}; and ND the largest from {1,5}. The product 
NA*NB*NC'ND should equal J, if the transform length is permissible. In the following, NA will be 
referred to as the first (or outermost) factor, NB the second, NC the third, and ND the fourth (or 
innermost). This reference is with respect to the order of pre-weave modules in the calculations (i.e., 
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NA is the size of the first pre-weave module and last post-weave module).t 


From the factors of N we can now determine via Table 1 the amount of data expansion that will 
occur in the pre-weave phase and, equivalently, the number of multiplications that will be performed in 
the WFTA. For each of the four variables (NA, NB, NC, and ND) the number of multiplications is 
assigned to the variables ND1, ND2, ND3, and ND4, respectively. In order to accommodate the data 
expansion of the WFTA, the working arrays SR(-) and SI(-) must be dimensioned as large as 
NDI*ND2*ND3*ND4. If the present upper limit on the transform size of 5040 is to be reduced, the 
size of the working arrays can be reduced by using Table 1 to determine the data expansion for the 
largest allowable transform size. 


Table 1 
Number of multiplications, M(N), needed 
for N-point WFTA 


N MU(N) 
2 mene 
5m 
Per 
Comet) 
heat, 
Semcemng 
9 
16 18 


Note: if N = ryXr)X + °° Xr, 


then M(N) = M(r,)M(rq)...M(r,) 


The second step of the INISHL subroutine is to calculate the constant coefficients for the multiplica- 
tion routine. These are generated from the coefficients of the individual factors as 


COEF(m, 12,13, m4) = COA(n,) *COB(n;) *COC(n3) *COD(n4) 


where 


The array COEF is actually treated as a one-dimensional array in the FORTRAN program, but can also 
be thought of as a multidimensional array in a mixed-radix index representation with the first index 
varying the most rapidly. Thus, the following addresses are equivalent:tt 


COEF(,23,73,m4) = COEF(m,+ND1 *n;+ND1 *ND2*n3+ND1 *ND2*ND3 *n,) « 
This method of data addressing will also apply to the data arrays SR(-) and SI(-). 


The third step of the INISHL subroutine is the calculation of the mapping vectors INDX1(-) and 
INDX2(-) for the pre- and post-permutations of the data. The pre-permutation of the data is done 
according to the Sino correspondence of Eq. (1). The mapping is implemented using the mapping vec- 
tor INDX1(-) to obtain the highest speed possible. The post-permutation requires the inverse mapping 
of the Chinese Remainder theorem, as in Eqs. (2) and (3). Again, for maximum speed a mapping vec- 
tor INDX2(-) is constructed. 


+ This order of pre-weave and post-weave modules will minimize the number of additions in the algorithm in all cases except 
N = 48, 240, 336 and 1680. The increases in additions for these cases is less than 4% compared with the optimal strategy [2]. 
The benefit of the order adopted here is a simpler program structure. 


tt The multidimensional arrays were not used in the FORTRAN program because it was found that a typical compiler produced 
much more efficient code with the one-dimensional arrays. 
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7POINT PRE WEAVE 7 POINT POST WEAVE 


Fig. 6 Seven-point DFT using Winograd’s decomposition. Nine multiplications are 
required. 

The three functions of the INISHL subroutine need only be performed once for a given value of 
transform length N. The remaining three subroutines form the computational core of the algorithm. 
The subroutine WFTA maps the data input arrays XR and XI into the working arrays SR and SI using 
the pre-permutation vector INDX1. The arrays SR and SI are treated as one-dimensional arrays of size 
ND1*ND2*ND3*ND4 in subroutine WFTA. Note that the WFTA is NOT computed in-place because 
of the nature of the permutations. 


BPOINT PREWEAVE BPOINT POST-WEAVE 


Fig. 7 Eight-point DFT algorithm using Winograd's decomposition. 


Next the subroutine WEAVE] is invoked to perform the pre-weave modules. The first pre-weave 
module performed is of length NA. If NA=1 the first module is skipped and the next factor, NB, is 
tested. Each factor NB, NC and ND is checked in turn. In WEAVE] the arrays SR and SI are treated 
as one-dimensional arrays to gain speed in execution. There is no 4-point pre-weave module because 
the 4-point DFT is implemented entirely as a post-weave module. Likewise, the 2-point pre-weave 
module is a 2-point DFT and there is no 2-point post-weave module. Documentation of the code for 
each pre-weave module can be found in the flowgraphs of Figs. 3 - 10. 
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9POINT PRE WE 


G9 POINT POST WEAVE MODULE 


AVE 
Fig. 8 Nine-point DFT algorithm using Winograd decomposition. Eleven multiplications 
are required, 
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16 POINT PRE WEAVE MODULE 


Fig. 9 Sixteen-point pre-weave module. 
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Following the WEAVE] subroutine the data is multiplied point-by-point by the real array COEF in 
the subroutine WFTA. Then the post-weave modules are implemented in the subroutine WEAVE2. 
The module of length ND (=5 or 1) is done first, then NC, NB and finally NA. The flowgraphs of 
Figs. 3 - 10 give the post-weave algorithms for the various factors. The multipliers for the 16-point 
DFT algorithm are given in Table 2. Finally, subroutine WFTA performs the post-permutation by 
mapping SR and SI to XR and XI via the mapping vector INDX2(-:). This completes the WFTA calcu- 


lation, 


Table 2 
Multipliers for 16-point DFT Algorithm 


—v2/2 
—0.5411961001 
=10) 
—1.306562965 
V2/2 
1.306562965 
—0.9238795325 
0.3826834324 


16POINT POST WEAVE MODULE 
Fig. 10 Sixteen-point post-weave module. 
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4. Description of Parameters’ 


CDA, CDB, CDC, CDD: real arrays that are assigned coefficients of the factors of N during initializa- 
tion (CDA: for outermost factor, CDD: for innermost factor). 

CO3, CO4, CO8, CO9, CO16: real arrays containing the short-DFT coefficients for factors 3,4,8,9,16 
respectively. 

COEF: real array of size ND1*ND2*ND3*ND4 to which the N-point DFT multiply coefficients are 
assigned during the initial run. 

INDX1, INDX2: integer arrays of size N for storing initial and final permutation mappings respectively. 

INIT: integer variable passed from user program to WFTA. It must be zero on the initial run and 
nonzero otherwise. 

INVRS: integer variable to flag the inverse transform (INVRS = 1), otherwise (INVRS = 1) the for- 
ward transform is calculated. 

TERR: integer variable that returns error code indicating successful completion (IERR=0) or abnormal 
termination (IERR=—1 or —2). 

N: transform length 

NA, NB, NC, ND: integer variables for four factors of N (NA: outermost, ND: innermost). 

ND1, ND2, ND3, ND4: integer variables representing the "expansion" of factors NA, NB, NC, ND, 
respectively. See Table 1. 

NMULLT: integer variable equal to product of ND1, ND2, ND3, and ND4. 

SR, SI: real arrays of size ND1*ND2*ND3*ND4 to which XR, XI are transferred during initial permu- 
tation. 

XR, XI: real and imaginary parts respectively of complex input data array, The transformed data are 
also placed in these arrays by the final permutation. 


5. Summary of User Requirements 
(1) Specify input sequences XR and XI and parameters N, INVRS, INIT and IERR. 


(2) Call WFTA. For initial call use INIT=0; INVRS = 1 means the inverse DFT will be computed. 


(3) Output is obtained in XR and XI. The error code IERR is zero for successful completion and —1 
or —2 if the value of Nis not permissible or was not initialized. 


(4) After initial call, use INIT~0 for all other calls as long as Nis not changed. 


6. Test Example 


A main program is provided to generate a test waveform whose DFT is known analytically. For this 
purpose a complex exponential signal was chosen 


iad 
x[n] = is ni } n=0,1,...,.N-1 (4) 
where Nis the transform length to be tested. The DFT is easily calculated to be 
Qn )% 
j3t 
_( 
Xtk) = a (5) 
l-re % 


Thus the WFTA can be checked by comparing the results of a DFT computation with Eq. (5). The 
Program will print out the maximum absolute and relative differences between the computed DFT and 
the ideal. The test example was run for the case N = 28, forward transform, r = 0.98, and @ = 0.5 
with the corresponding input and output given in Tables 3 and 4 respectively. By choosing different 
values for N the various pre-weave and post-weave modules can be exercised. Different inputs can be 
obtained by varying rand ¢. The choice r ~ 1 and 6 = 0 mod N must be avoided since Eq. (5) does 
not hold in this case, 


7, Summary 


A FORTRAN program for the calculation of the DFT using Winograd’s "nested" algorithm has been 
presented. While every effort has been made to provide a computationally efficient program, some 
compromises have been made to simplify the program structure. For example, the multiplications of 
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the WFTA are all performed in a separate DO loop. A slightly more efficient implementation of the 
algorithm would provide code so that the innermost module of the pre-weave and post-weave computa- 
tions is combined with the multiplications. For example, in Fig. 1 the innermost module is the 5-point 
factor. The advantage of such an approach is that it avoids some memory transfers (loads and stores) 
that are required in our implementation. Furthermore, it reduces slightly the amount of memory 
required for the arrays SR and SI. The disadvantage, of course, is that an additional block of code must 
be provided for each factor in the set (2,3,4,5,7,8,9,16) to allow for the possibility of each factor being 
the innermost. This could conceivably double the amount of program code. 


Another possible improvement in the WFTA that would be quite helpful, would be the develop- 
ment of input and output permutations that could be done "in-place". If this were possible, the arrays 
SR and SI could share memory with XR and XI and only an additional (ND1*ND2*ND3*ND4 — N) 
locations would be needed to accommodate the data expansion of the WFTA. 


If one only requires an algorithm to compute the DFT of real data, a rather simple modification of 
the existing program will exploit the real-valued nature of the input. The input permutation, subrou- 
tine WEAVE1 and the multiplications should be modified to remove all calculations involving the array 
SI which will be zero, until subroutine WEAVE2 is called. This will result in a slight improvement in 
the running time of the algorithm for real data. 

As a final comment, it should be pointed out that this program is an initial attempt to produce an 


efficient WFTA program, and it is quite likely that future developments related to Winograd’s algorithm 
will lead to more efficient implementations. 
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LENGTH = 
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ABSOLUTE DEVIATION = 
RELATIVE DEVIATION = 


1REAL 
2REAL 
3REAL 
4REAL 
SREAL 
6REAL 
TREAL 
8REAL 
OREAL 
10REAL 
11REAL 
12REAL 
13REAL 
14REAL 
1SREAL 
16REAL 
17REAL 
18REAL 
19REAL 
20REAL 
21REAL 
22REAL 
23REAL 
24REAL 
25REAL 
26REAL 
27REAL 
28REAL 
1REAL 
2REAL 
3REAL 
4REAL 
SREAL 
6REAL 
TREAL 
SREAL 
QREAL 
10REAL 
11REAL 
12REAL 
13REAL 
14REAL 
15REAL 
16REAL 
17REAL 
18REAL 
19REAL 
20REAL 
21REAL 
22REAL 
23REAL 
24REAL 
25REAL 
26REAL 
27REAL 
28REAL 


Table 4 


0.10000000E 01IMAG 
0.97383796E OOIMAG 
0.93632076E OOIMAG 
0 .88837543E OOIMAG 
0.83102498E OOIMAG 
0.76537160E OOIMAG 
0.69257944E OOIMAG 
0.61385744E OOIMAG 
0.53044206E OOIMAG 
0 .44358054E OOIMAG 
0,35451459E OOIMAG 
0.26446479E OOIMAG 
0.17461589E OOIMAG 
0 .86103185E-01 IMAG 
0.22561488E-18IMAG 
-0 .82693498E-01 IMAG 
-0.16106014E OOIMAG 
-0.23427411E OOIMAG 
-0.30160790E OOIMAG 
-0.36243759E OOIMAG 
-0.41624673E OOIMAG 
-0.46262869E OOIMAG 
-0.50128740E OOIMAG 
-0.53203680E OOIMAG 
-0.55479886E OOIMAG 
-0.56960024E OOIMAG 
-0.57656787E OOIMAG 
-0.57592328E OOIMAG 
0.32239256E 01IMAG 
0.32239256E 01IMAG 
0.10652301E 01IMAG 
0.88719223E OOIMAG 
0.83803070E OOIMAG 
0.81782128E OOIMAG 
0.80763211E OOIMAG 
0.80182080E OOIMAG 
0.79823032E OOIMAG 
0.79589333E OOIMAG 
0.79432575E OOIMAG 
0.79326570E OOIMAG 
0.79256435E OOIMAG 
0.79213571E OOIMAG 
0.79193212E OOIMAG 
0.79193209E OOIMAG 
0.79213572E OOIMAG 
0.79256435E OOIMAG 
0.79326568E OOIMAG 
0.79432572E OOIMAG 
0.79589333E OOIMAG 
0.79823034E OOIMAG 
0.80182078E OOIMAG 
0.80763214E OOIMAG 
0.81782126E OOIMAG 
0.83803074E OOIMAG 
0.88719221E OOIMAG 
0.10652301E 01IMAG 
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0.10972519E 
0.21370910E 
0.31085601E 
0.40020054E 
0 .48091486E 
0.55231368E 
0.61385744E 
0.66515329E 
0.70595438E 
0.73615713E 
0.75579695E 
0.76504221E 
0.76418691E 
0.75364190E 
0.73392510E 
0.70565056E 
0 .66951695E 
0.62629525E 
0.57681611E 
0.52195689E 
0 .46262869E 
0.39976336E 
0 .33430089E 
0.26717705E 
0.19931175E 
0.13159785E 


0 .64890968E- 


0.13521341E 
-0.13521341E 
-0.45975034E 
-0.27176643E 
-0.18913968E 
-0.14179013E 
-0.11045912E 
-0.87708147E 
-0.70048606E 
-0.55618385E 
-0.43323722E 
-0 .32469963E 
-0.22583816E 
-0.13319096E 


-0.44023335E- 
0 .44023335E-( 


0.13319093E 
0 .22583811E 
0.32469966E 
0.43323717E 
0.55618381E 
0.70048602E 
0.87708144E 
0.11045912E 
0.14179012E 
0.18913967E 
0.27176643E 
0 .45975034E 


0.11920929E-06 AT INDEX oO 
0.0000025 PERCENT AT INDEX 20 
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00 
00 
00 
00 
00 
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00 
00 
00 
00 
00 
00 
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1. Purpose 


This program uses the autogen technique [1-3] to implement a time efficient radix-4 fast Fourier 
transform. It is designed for those applications in which a fixed-size transform is performed repeatedly, 
such as speech analysis/synthesis (e.g., vocoders, spectrogram production) and two-dimensional picture 
processing. In such applications, speed optimization is especially profitable. Sample benchmark times 
for a 1K complex transform are: 


Computer Compiler Time 
DEC PDP-11/55 FORTRAN IV PLUS 250 msec 
DEC VAX 11/780 FORTRANIV PLUS 150 msec 


IBM 370/168 FORTRAN H 32 msec 


Finally, the program was derived from the radix-4 subset of Singleton’s mixed-radix FFT [4] and thus 
illustrates the application of autogen techniques to speed optimization of other DSP software, such as 
that presented in this book. 


2. Method 


An autogen program is time efficient because most data-independent computation required for algo- 
rithm implementation is done prior to program execution. Such computation includes that necessary 
for data or coefficient access and algorithm flow control, including selection of the time optimum com- 
putational kernel (ck) applicable at any point in the algorithm. Conceptually, an autogen program for a 
selected size transform can be produced by unwinding the loops of any program whose flow is data- 
independent. The result is a customized program consisting essentially of a linear sequence of ck’s. 
Each ck may then be the optimum for that point in the algorithm and may contain precomputed con- 
stants which are pointers to data and/or coefficients necessary for execution of that ck. This code gen- 
eration can in fact be automated by simply transforming an existing program into a generator program 
by replacing all sequences which operate on data points with "write" statements. When executed, the 
new program will then generate code, into a disc-based file for example. The file contents are then 
compiled/assembled to produce a customized, time efficient program [1]. However, excepting those 
cases when the ck size is "small" [2], in-line code is prohibitive insofar as memory storage requirements 
are concerned, and is a retrograde step for software speed enhancement on machines with cache 
memories. An alternative program structure for autogen software is "threaded code" [2,5]. In threaded 
code, the memory storage is divided into 


(a) a set of computational kernels 
(b) a data-point storage space 
(c) a coefficient storage space (when necessary), and 


(d) a driver array, or "thread". 
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The thread elements are accessed sequentially and consist essentially of precomputed pointers to ck’s, 
data, and coefficients. This means that no matter how complex the algorithm-dependent computation 
Tequired at program generation time to determine the time optimum ck to invoke at any point during 
algorithm execution, the relevant ck can be invoked at run time by a single "computed go to" based on 
the value of a precomputed array element. Alternatively, using the premise that each ck must accept at 
least one nonzero data pointer per invokation, a time efficient "branch on nonzero (integer) pointer" 
can re-invoke the current ck. Because DSP ck’s are generally executed a number of times before tran- 
sition to the next, this strategy -- "knotted code" [2] -- is to be preferred and is in fact used in this FFT 
autogen program. 


In the radix-4 FFT, each butterfly includes three complex multiplications. Examination of the algo- 
rithm reveals that the multiplications required can be minimized by implementation of 5 different 
butterfly ck modules [6]. Further, by performing each nontrivial complex multiplication using a 3 mul- 
tiply/3 add algorithm, possible when a table of (sin #, — cos @,), —(sin @, + cos @,) and cos 6, is stored, 
the 5 ck’s required have the following characteristics for an N = 4**M point complex transform: 


ck # Multiplications # Invokations 

1 0 [4**M—1]/3 

2 4 [4**(M—1)—11/3 

3,4 8 2[4**(M-1)—1]/3 

5 9 4°*(M—1)[M—7/3]+4/3 


The total number of butterfly invokations is then M[4**(M—1)] = MN/4. These require 7,856 real 
multiplications and 28,341 real additions for M = 5, compared to 28,920 real additions and 15,112 real 
multiplications for Singleton’s program. Using the DEC FORTRAN IV PLUS compiler, 59,725 
floating-point register load/stores were executed (for M = 5) compared to 77,763 for Singleton’s pro- 
gram. 


In the documented program, thread and trig table generation are done during a first pass. This 
simplifies the program in terms of transportability (no disc file manipulation required) but means that 
the generator program is resident during FFT execution. Program storage requirements, in 16-bit 
words, are approximately 0.6NM + 5.2N + ck storage space. For the IBM 370 FORTRAN H and DEC 
FORTRAN IV PLUS compilers, ck storage space is about 1100 and 1500 16-bit words, respectively. 
An indication of the program time efficiency is that during execution of the program on a PDP-11/55, 
only about 10% of time is devoted to operations other than load/store and add/subtract/multiply of 
floating-point operands [6]. The relative speed increase as compared to conventional programs is very 
machine dependent. Time savings due to reduction of algorithm-dependent (and thus data- 
independent) operations will be greatest on modern computers which have hardware floating-point pro- 
cessors such that floating-point instructions require the same order of execution time as the 
nonfloating-point instructions eliminated. On machines with slow "software" floating-point arithmetic 
instructions, the nonfloating-point operations are, relatively, of less importance. However, on these 
machines, the reduction in "expensive" data-dependent operations via the ability of the autogen tech- 
nique to economically invoke the time optimum ck (i.e., the one containing the fewest possible data- 
dependent operations), provides valuable time savings. 


As noted earlier, the program was derived from the radix-4 subset of the well known Singleton 
mixed-radix program and implements 
N-1 


~/2™ nk 
X(k) = ¥ x(nde N , k=0,...,.N—1 (forward transform) 


n=0 


or 


N=1 Pen 
x(n) = (/N) & X(k)e * ee n=0,....N—1 (inverse transform) 


k=0 
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The following table summarizes relative performance on the PDP-11/55. For completeness, execu- 
tion times for an assembly language floating-point autogen FFT have been included [7]. As noted in 
[6], use of floating-point registers as temporary storage locations can be better optimized at the assem- 
bler level, thus reducing the load/store operations of floating-point data. 


Autogen Autogen Singleton 
N (a) Assembler (6) FIVPLUS' (c) FIVPLUS’) ()Ka)_— (Xb) 
16 0.90 msec 1.58 msec 3.23 msec 3.59 2.04 
64 5,80 msec 9.07 msec 14.56 msec 2.51 1.60 
256 33.00 msec 49.57 msec 71.51 msec 2.16 1.44 


1024 168.70 msec 250.01 msec 343.88 msec 2.03 1.37 
As per sec. 2, the proportion of time-favorable butterflies decreases with increasing N. Thus, use of this 
program for transforms of size 4 K or more is inappropriate from a time/space tradeoff point of view. 


3. Program Description 


3.1 Usage 


The program consists of the basic subroutine RADIX4, which includes the 5 butterfly ck’s and the 
autogen code, and a small subroutine RAD4SB, used by the autogen. Much of the notation of the ori- 
ginal Singleton program has been preserved. The user passes the data in an array "A", in labeled com- 
mon block "AA". This step is essential for ensuring "optimum" data addressing techniques used by optimizing 
compiler generated code. 


3.2 Description of Parameters 


The basic call is of the form 
CALL RADIX4(M,IFLAG,JFLAG) 


where N = 4**M complex points are to be transformed and 2 < M < 5 


IFLAG = 1 on the first call 
= 0 on subsequent calls with the same value of M. 


JFLAG = —1 for a forward transform 
= +1 for an inverse transform. 


On input, the array A (passed in labeled common) contains the complex data points, real in odd array 
components, imaginary in even array components. On output, the array A contains the complex DFT 
coefficients ¥(k) or x(n) as per JFLAG. 


3.3 Dimension Requirements 


The DIMENSION statements in the main program and both subroutines can be modified to reflect 
the largest size transform to be implemented as follows: 
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Array Dimensions 
A IX (i 


M=2 32 38 27 


M<4_ 512 658 567 


M<5 2048 2996 2295 
Arrays A and T are real (floating-point) and array IX is INTEGER"2, i.e., 16-bit. 


3.4 Summary of User Requirements 


On each call to RADIX4, load A with the input data and retrieve the output data from A. On the 
first call for a given size M, use IFLAG=1, on subsequent calls use IFLAG=0, For a DFT use 
JFLAG = —1, for an IDFT use JFLAG = +1. 


4. Test Program 


For 3 < M < 5, N =4**M, compute the DFT of a complex sequence generated by UNI, then 
compute the IDFT of the result. The RMS error between DFT input and IDFT output is printed in 
each case. For N = 64, the DFT/IDFT input and output are listed. Note that the error will vary 
according to the format (e.g., bits for fraction) of floating-point numbers on any particular machine. 
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Tabk 
DFT INPUT 

REAL IMAG 

0.229256 0.766875 
0.683177 0.509191 
0.874560 0.644641 
0.847468 © 0. 353963 
0.398892 0.457094 
0.236309 0.133182 
0.166052 0.226027 
0.662459 0.250212 
0.617697 0.262465 
0.512668 0.939207 
0.624028 0.422382 
0.939706 0.282068 
0.469218 0.054879 
0.519831 0.396827 
0.113157 0.607517 
0.701507 0.887055 
0.331433 = 0.220961 
0.168616 0.992249 
0.367070 0.497800 
0.254104 0.797795 
0.133912 0.116143 
0.212882 0.783360 
0.982931 0.788486 
0.365426 0.476909 
0.827320 0.102528 
0.943264 0.684253 
0.729065 0.722039 
0.340034 0.410316 
0.384621 0.961848 
0.480094 0.096515 
0.519834 0.761804 
0.704444 = 0, 340203 
0.460761 0.475524 
0.748171 0.654245 
0.421876 0.441382 
0.774413 0.625799 
0.524052 0.092862 
0.984750 0.829579 
0.192729 0.291600 
0.385426 0.467851 
0.320288 0.242745 
0.801388 0.025701 
0.985884 0.904574 
0.105523 0.237869 
0.253360 0.134264 
0.979304 0.629147 
0.445763 = 0.913431 
0.270815  0,408028 
0.234614 0.644116 
0.723286 0.768105 
0.194135 0.632751 
0.158584 0.594914 
0.158079 0.353140 
0.055275 0.430064 
0.546173 0.499216 
0.915547 0.623864 
0.633616 0.045868 
0.580915 = 0.172191 
0.969972 0.916135 
0.400834 0.777754 
0.568952 0.427517 
0.124854 © 0.777654 
0.047415 0.260892 
0.069980 0.787919 
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DFT 
REAL 
31377766 
-1.565459 
-0.562676 
-1.280178 
-3.942028 
-2.127302 
0.364557 
-0.179658 
3.244458 
1.399128 
0.541036 
-0.624628 
1.187343 
1.564005 
0.138395 
2.695570 
-1.135619 
2.194667 
0.264126 
-1.419245 
2.231800 
1.686178 
-3.398292 
0.976109 
-0.999293 
3.917623 
1.067974 
-4.502048 
0.645658 
-1.795084 
0.052220 
2.705629 
-1.924339 
-1.059475 
0.055644 
6.071876 
-4.694662 
2.227794 
1.329456 
1.600311 
-0.051197 
-0.497059 
-0.116100 
2.017721 
1.047104 
-3.381618 
0.277854 
2.875121 
-2.133524 
-0.886670 
1.965688 
0.325368 
0.403606 
-0.313278 
-4.102506 
-1.932684 
0.861630 
0.113929 
1.158827 
0.789765 
-2.839772 
-0. 988682 
4.481467 
-1,661487 


OUTPUT 
IMAG 
32.033501 
-0.613354 
-1.274236 
0.779767 
4.433803 
0.555010 
-6.019432 
-0.879471 
-2.330645 
-1.712091 
0.833928 
-3.266858 
1.579592 
-2.370283 
3.839718 
4.165845 
-5.030361 
1.753474 
0.562021 
3.509271 
0.938169 
3.474952 
0.256503 
2.695807 
0.800101 
-2.189232 
-0.777765 
-0.440295 
-0.914912 
0.368239 
7-1.359995 
0.261653 
-2.254483 
-1.224388 
4.737301 
0.011771 
0.357120 
-0.556963 
1.476440 
-1.237184 
-1.647760 
0.466700 
-1.350873 
3.162251 
1.395429 
0.410234 
1.371036 
-1.404488 
-3.313334 
-1.253150 
2.067677 
3.580138 
1.931254 
1.078680 
-1.050208 
2.410821 
3.831643 
3.341182 
4.071988 
0.218662 
1.910510 
1.583505 
0.320888 
0.184884 
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IDFT OUTPUT 


Table 1 
(Continued) 
DFT INPUT 
REAL IMAG REAL 
0.229256 0.766875 0.229256 
0.683177 0.509191 0.683177 
0.874560 0.644641 0.874560 
0.847468 0.353963 0.847468 
0.398892 0.457094 0.398892 
0.236309 0.133182 0.236309 
0.166052 0.226027 0.166052 
0.662459 0.250212 0.662459 
0.617697 0.262465 0.617697 
0.512668 0.939207 0.512668 
0.624028 0.422382 0.624028 
0.939706 0.282068 0.939706 
0.469218 0.054879 0.469218 
0.519831 0.396827 0.519831 
0.113157 0.607517. 0.113157 
0.701507 0.887055 0.701507 
0.331433 0.220961 0.331433 
0.168616 0.992249 0.168616 
0.367070 0.497800 0.367070 
0.254104 0.797795 0.254104 
0.133912 0.116143 = 0.133912 
0.212882 0.783360 0.212882 
0.982931 0.788486 0.982931 
0.365426 0.476909 0.365426 
0.827320 0.102528 0.827320 
0.943264 0.684253 0.943264 
0.729065 0.722039 0.729065 
0.340034 0.410316 0.340034 
0.384621 0.961848 0.384622 
0.480094 0.096515 0.480094 
0.519834 0.761804 0.519834 
0.704444 0.340203 0.704444 
0.460761 0.475524 0.460761 
0.748171 0.654245 0.748171 
0.421876 0.441382 0.421876 
0.774413 0.625799 0.774412 
0.524052 0.092862 0.524052 
0.984750 0.829579 0.984750 
0.192729 0.291600 0.192729 
0.385426 0.467851 0.385426 
0.320288 0.242745 0.320288 
0.801388 0.025701 0.801388 
0.985884 0.904574 0.985884 
0.105523 0.237869 0.105523 
0.253360 0.134264 0.253360 
0.979304 0.629147 0.979304 
0.445763 0.913431 0.445763 
0.270815 0.408028 0.270815 
0.234614 0.644116 0.234614 
0.723286 0.768105 0.723286 
0.194135 0.632751 0.194135 
0.158584 0.594914 0.158584 
0.158079 0.353140 0.158079 
0.055275 0.430064 0.055275 
0.546173 0.499216 0.546173 
0.915547 0.623864 0.915547 
0.633616 0.045868 0.633616 
0.580915 0.172191 0.580915 
0.969972 0.916135 0.969972 
0.400834 0.777754 0.400834 
0.568952 0.427517 0.568952 
0.124854 0.777654 0.124854 
0.047415 0.260892 0.047415 
0.069980 0.787919 0.069980 


RMS ERROR FOR M = 3 IS 


RMS ERROR FOR M 


41s 


RMS ERROR FOR M = 5 IS 
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IMAG 
0.766875 
0.509191 
0.644641 
0.353963 
0.457094 
0.133182 
0.226027 
0.250212 
0.262465 
0.939207 
0.422382 
0.282068 
0.054879 
0.396827 
0.607517 
0.887055 
0.220961 
0.992249 
0.497800 
0.797795 
0.116143 
0.783360 
0.788486 
0.476909 
0.102528 
0.684253 
0.722039 
0.410316 
0.961848 
0.096515 
0.761804 
0.340203 
0.475524 
0.654246 
0.441382 
0.625799 
0.092862 
0.829579 
0.291600 
0.467851 
0.242745 
0.025701 
0.904574 
0.237869 
0.134263 
0.629147 
0.913431 
0.408028 
0.644116 
0.768105 
0.632751 
0.594914 
0.353140 
0.430064 
0.499216 
0.623864 
0.045868 
0.172191 
0.916135 
0.777754 
0.427517 
0.777654 
0.260892 
0.787919 


0.114103E-06 
0.221640E-06 
0.566590E-06 
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Two-Dimensional Mixed Radix Mass Storage Fourier Transform 


Richard C. Singleton 


SRI International 
Menlo Park, CA 94025 


1. Purpose 


Two-dimensional mixed radix fast Fourier transform algorithms are presented, for use with a mass 
storage data file. These transforms operate on both real and complex input sequences. A transform (or 
inverse) is computed in two passes of the mass storage file. The method can be applied to any multi- 
dimensional transform that operates on the dimensions one by one, and is not limited to two dimen- 
sions. 


Transforms of size 1024 by 1024 have been computed on the Burroughs 6700 and the CDC 6400; 
on both machines the program runs without problem in the normal mix, and the transform size is 
apparently limited only by the size of the mass store. 


2. Method 


The basic fast Fourier transform subroutines used here (FFT and REALT) are presented and tested 
in an earlier Section (1.4.). The new idea here is a permutation method to allow use of the basic FFT 
routines to do larger transforms on data on mass store. 


If we assume a mass storage file to be an NI by N2 array, stored with records written by columns, 
where N1 is an integer multiple of the record length, then the FFT by columns is simple. The problem 
is, how do we transform the rows? 


This problem is solved here by following the FFT operation on the columns by a permutation of the 
input buffer so that the intermediate results can be written back to the input file in such a way as to 
partition the file into M1 by M2 sub-matrices, where M1*M2 is the record size of the file. After this is 
done, the file can be read back either by rows or by columns. M1 must be a multiple of 2, as the data 
are complex. N1 must be a multiple of M1*M2, the record size. However N2 need only be a multiple 
of M2. 


On the first pass of the file, columns of length N1 are read into the input buffer in consecutive 
groups of M2. On the second pass of the file, N2/M2 sub-matrices of size M1 by M2 are read into the 
input buffer; the buffer then contains the values for M1 rows of length N2. Thus the input buffer must 
have dimension MAX0(N1*M2,N2*M1). 


For a real transform, 2*M2 additional buffer locations are needed for the folding frequency Fourier 
coefficients, thus the buffer must have dimension MAX0((N1+2)*M2,N2*M1). Also, during a real 
transform or inverse, a working store of size 2*N2 is set up within the subroutine FFT2T or FFT2I. 


This method can be generalized to higher-dimensional Fourier transforms, by sub-dividing either or 
both of the dimensions N1 and N2 used here. The method can also be applied to other transforms that 
operate independently on rows and columns. 
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3. Usage 
3.1 Transform of Complex Input Data, N1/2 By N2 
CALL FFT2T(A,J1,K2,11,M2,0) (transform, no scaling) 
CALL FFT21(A\I1,K211,M2,0) (inverse, scaled) | 
where 
A Is real array dimensioned to MAX0(N1*M2,N2*M1) 
MI=I1*2 Is the column dimension of the sub-matrix partitioning 
M2 Is the row dimension of the sub-matrix partitioning 


N1=J1*M2#*M1 Is the column dimension of the data 

N2=K2*M2 Is the row dimension of the data 

On entry, the complex data are on the mass storage file in columns of length Nl, or N1/2 complex 
values. Real and imaginary components alternate. 


On completion of the transform, the data are left on the mass storage file, partitioned in sub- 
matricies of size Ml by M2, so that the results can be read either by columns or rows. The inverse 
transform expects input in this form. On completion of the inverse, the data are left on the mass 
storage file in sequential records by columns, scaled by 2/(N1*N2). 


A call on FFT2T, followed by a call on FFT2I with the same input parameters, produces an identity 
transformation. 


The mass storage file LUN should be declared by the user to have a logical record size of M1*M2; 
the unit number LUN is communicated through labeled common FFTCOM. 


3.2 Transform of Real Input Data, N1 by N2 


CALL FFT2T(A,J1,K2,11,M2,1) (transform, no scaling) 
or 
CALL FFT21(A,J1,K2,11,M2,1) (inverse, scaled by 1/N) 


where the parameters are the same as in 3.1, except that any nonzero value for the sixth parameter 
causes the additional steps for a real transform or inverse to be done. 


On completion of the transform, the Fourier coefficients are left on the mass storage file, partitioned 
in sub-matrices of dimension M1 by M2, with the cosine and sine coefficients alternating down 
columns. The N2 folding frequency cosine coefficients (alternating with zero sine coefficient values) 
are stored at the end of the main file in records of length M1*M2, with a possible final short record to 
bring the total length of the added records to 2#N2. The inverse transform expects data in this form. 
On completion of the inverse, the real data is in sequence down columns. 


A call on FFT2T, followed by a call on FFT2I with the same input parameters, produces an identity 
transformation. 


3.3 Other Subroutines Needed: 


TRNSP, EXCH and XFT --- included here 
FFT, FFTMX, REALT, ISTKGT and ISTKRL --- from Section 1.4 


MFREAD and MFWRIT -- machine-dependent mass storage read and write subroutines. The versions 
used here were copied from "Optimized Mass Storage FFT Program," by Donald Fraser. His 
subroutines for the PDP 11 work on the Burroughs B6700 computer. They should also work on 
an IBM 360/370. For publication, the mass storage file LUN has been replaced by an array 
RMAS; this version was also tested. 
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3.4 Error Conditions 


The signs of J1, K2, 11 and M2 are ignored. Thus the only error condition recognized by FFT2T or 
FFT21 is 


Jl#K2*I1*M2 =0 


This condition results in an error condition and no transform. 


4. Testing 


The subroutines included here were tested on a Burroughs B6700 computer. A real transform of 
size Nl = 240 by N2 = 225 was done with FFT2T, using consecutive integers from 0 to 53,999 as test 
data. The inverse was then done with FFT2I, and the result compared with the input. The square root 
of the sum of squares of the errors divided by the sum of squares about the mean for the input was 
computed as an accuracy check; the result was 0.147E-10 (see Table 1). The record size used was 240, 
allowing sub-matrices of size M1 = 16 by M2 = 15. The buffer size was thus 3630, and an additional 
450 working storage locations were set up within FFT2T and FFT2I on a temporary basis, using 
ISTKGT and ISTKRL. Average CP time for the transform or inverse was 82 seconds. Most of this is 
time for FFT and REALT, as when the calls on these subroutines were. removed and the permutation 
alone was tested, the average time each direction was 7 seconds. 


Table 1 
TEST OF TWO-DIMENSIONAL MIXED RADIX FFT 
RECORD SIZE = 240 BUFFER SIZE = 3630 240 BY 225 TRANSFORM 
RMS ERROR NORM FOR TRANSFORM-INVERSE PAIR = .147E-10 


MAXIMUM STACK SIZE = 4147 
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CHAPTER 2 


Power Spectrum Analysis and Correlation 


L. R. Rabiner 


Introduction 


The programs in this and the next section are various implementations of high speed convolution, 
correlation, and spectrum analysis algorithms. A wide variety of techniques have been proposed in this 
area and the four programs presented are only a small sampling of those available. However, they do 
serve to illustrate the types of techniques which have been applied in a wide variety of applications. 


The first program by Rabiner, Schafer, and Dlugos is an implementation of the method of modified 
periodograms, as proposed by Welch [1], for directly estimating the power spectrum of a signal. 


The second program, again by Rabiner, Schafer, and Dlugos, is an implementation of the correlation 
method, as proposed by Rader [2], for directly estimating the correlation function of a signal. 


The third program in this section, by Carter and Ferrie, is one for estimating the coherence function 
of a signal. Such techniques are widely applied in the areas of sonar, radar, and other underwater appli- 
cations of digital signal processing. 


A recent IEEE Press volume [3] describes several other valuable algorithms for power spectrum 
analysis. Although programs are not included in that volume the interested reader should consult that 
reference for alternative methods of computing spectra and correlation functions of digital signals. 
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2. C. M. Rader, "An Improved Algorithm for High Speed Autocorrelation with Applications to Spec- 
tral Estimation", JEEE Trans. on Audio and Electroacoustics, Vol. AU-18, No. 4, pp. 439-442, Dec. 
1970. 
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Periodogram Method for Power Spectrum Estimation 


L. R. Rabiner 


Acoustics Research Dept. 
Bell Laboratories 
Murray Hill, NJ 07974 


R. W. Schafer and D. Dlugos 


Dept. of Electrical Engineering 
Georgia Institute of Technology 
Atlanta, GA 30332 


1. Purpose 

This program can be used to obtain a direct estimate of the auto-power spectrum of a signal using 
the method of averaging periodograms. 
2. Method 


The use of the FFT in this manner was first described by Welch [1]. The essential features of the 
method are given below. Further details are available in Refs. (1-3). 


A sequence x(n) has a power spectrum denoted P,,(w). The modified periodogram spectrum esti- 
mate is obtained by dividing an available segment of x(n), 0 < n < N—1 into K overlapping segments 
of length L. In this implementation, the segments overlap by L/2 samples, giving the total number of 
segments as 


K =((N — L/2)/(L/2)] 
where [x] denotes the integer part of x. The / th segment of data is defined as 
x(n) = x(iL/2+n)waln) 0K n <L-l, O< i < K-1 a) 


where, w,(n) is an L-point data window (e.g., rectangular, Hamming, etc.). The M-point (M 2 L) 
DFTs of the windowed segments x,(n) 


Mz =. 
Xk) =" xe!" O<k MA, 0<i< K-1 (2) 
n=O 


are computed using an FFT algorithm. (If L < M, the sequence x(n) is augmented with M—L zero 
valued samples.) The modified periodograms 


S(k) =|X(OP Ok <M-1, 0<i< K-1 (3) 


are averaged to produce the spectrum estimate at normalized radian frequency 2ak/M 


K=1 
Se2k/M) = 2" s(k) 0< k < MHL. (4) 
KU =O 
where 
iz 
U=F wa). (5) 
n=0 


The quantity U is necessary for the spectrum estimate to be unbiased [1]. 
It can be shown [1,3] that the expected value of S,,.(27k/M) is 


ElSQmk/M)1 = ff P.(0) W2rk/M—6)a09 ) 
2a Y-7 
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The effective spectrum smoothing "window" is 


Ww) = + Wyo)? @) 
where 
L-1 
Ww) = ¥ wlneio" (8) 
n=O 


is the Fourier transform of the data window sequence, w,(n). 
It can also be shown [1] that the variance of the spectrum estimate, S,,(27k/M), is 


var Sqq(2ek/M)] = Lh P2Qmk/M) . (9) 


Since the width of the spectrum window W(e/*) is inversely proportional to L, and the variance of the 
spectrum estimate is inversely dependent on KX, it is clear that for N = (K +1) (L/2) fixed, good fre- 
quency resolution and low variance are conflicting requirements. Clearly resolution can be traded for 
low variance by using many short segments, and greater resolution can be achieved at the expense of 
greater statistical variance of the estimate. 


3. Program Description 
A flow chart of the program is shown in Fig. 1. 


M, IWIN, LN, FS. 


Fig. 1 Flow diagram of program, PMPSE. 


First the program reads in parameters such as FFT size, window type, window length, maximum 
number of data samples available and sampling frequency of the data. Then the mean is estimated so 
that it can be subtracted from the data. (This is desirable so that the low frequency portion of the spec- 
trum is not obscured.) Next the modified periodograms are computed for the available data, and accu- 
mulated according to Eq. (4). 


A notable feature of the program is that the periodograms |X,(k)|? are computed two at a time. It 
can be shown [1] that if two real segments x;() and x,,;(m) are used as real and imaginary parts of a 
sequence 
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x(n) = x(n) + x4) (10) 
then 
X(k)X*(k) + X(M—k)X*(M—k) = 20|X(K) ? + [XP] OS k < M/2 a 


where X(k) is the M-point transform of the complex sequence, x(n), and X,(k) and X,4;(k) are the 
M-point DFT’s of x,(m) and x,4;(m) respectively. Thus the left hand side of Eq. (11) gives two 
periodograms from one FFT computation. 


The final step in the program is the normalization by K-U and the computation of 
20 logiolS,.(27k/M)]. At this point the spectrum estimate is available for plotting, etc. 


An estimate of the autocovariance of x(n) is then obtained by taking the inverse DFT of the power 
spectral estimate. Since only a sampled version of the power spectrum is available, the resulting auto- 
covariance is an aliased version of the true autocovariance of x(n) [2]. 


3.1 Usage 


The main program (PMPSE) requires two user supplied subroutines; GETX for accessing blocks of 
data, and FFT, a complex, radix 2, FFT subroutine. The main program reads in analysis parameters, 
and then computes the estimates of the mean and power spectrum and then doés an inverse FFT to 
provide an autocovariance estimate of the input. The program prints out the log power spectrum (in 
dB), and the autocovariance function. 


Although no graphical output capability is provided with the program, such can be supplied by the 
user at the places indicated in the main program. Typical graphical output is shown in the examples 
given below. 

3.2 Description of Program Parameters 
The main program PMPSE reads the following parameters: 


M FFT length. M must be a power of 2 (for compatibility with the FFT subroutine) that is less 
than or equal to the maximum value MAXM specified in the main program. 


IWIN Type of window used on data. If IWIN=1, a rectangular window is used; if IWIN=2, a Ham- 
ming window is used. 

E Window length. Must be less than or equal to M. 

N Maximum number of data samples available for use in the analysis. Because of the windowing 
applied to the data, it is preferrable that N be exactly divisible by L/2. Thus the program 
processes only NSECT = (N—L/2)/(L/2) overlapping segments of length L or a total of NP = 
(NSECT+1)(L/2) samples. 

FS Sampling frequency in Hz. Used only for printing the power spectrum values. 


The user must supply the routine GETX which provides values of x(n) to the main program. The 
call to this routine is 
CALL GETX (X,NRD,SS) 
where the parameters X, NRD, and SS, are 


xX Array in which the samples of x(1) are stored 
NRD_ Number of samples of x (1) to be read into array X. 


Ss Starting sample number of x(), i.e., samples x(SS) to x(SS + NRD — 1) are read into array X 
in the subroutine GETX. Note that SS is a floating point number to allow for maximum flexi- 
bility. The first input sample is assumed to be x(1), i.e., SS = 1. 


The main program PMPSE, and test subroutine GETX are given in the Appendix. The subroutine 
FFT is a complex, radix 2, FFT subroutine with calling sequence CALL FFT(X,M,INV), where 
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M = Size of FFT (a power of 2) 
X = Complex array of length M 
INV = 0 for direct FFT 
1 for inverse FFT 


3.3 Dimension Requirements 


The real array XA is a data buffer and must be dimensioned to be the maximum window length; 
i.e., MAXM where MAXM is the largest FFT length. The complex array, X, (the working array for 
the FFT), and the real array, WD, (the window array) must be dimensioned MAXM. The real array 
SXX is used for accumulating the spectrum estimate. The real array XFR is used to generate a fre- 
quency scale corresponding to the DFT sample frequencies and the real array ILAG is used to generate 
a set of lag indices for printing. The arrays SXX, XFR and ILAG are all dimensioned (MAXM/2 + 
1). 


3.4 Summary of User Requirements 

(1) Provide the subroutine GETX which specifies the input data x(n). 

(2) Provide the complex FFT subroutine FFT. 

(3) Specify the analysis parameters, M, IWIN, L, N, and FS. 

(4) Provide graphical output of the power spectrum and autocovariance estimates. 


4. Test Problems 


To illustrate the use of this program a simple test problem is provided in the form of the subroutine 
GETX which generates samples of the sequence 


x(n) = cos(27n/10) , 
representing samples of a sinusoid of frequency FS/10, where FS is the sampling frequency. 
Example #1 


For this example, the parameters are M = 128, IWIN = 2, L = 64, N = 256, and FS = 10000. That 
is, a segment of length 256 is sectioned into 7 sections of length 64 each weighted with a Hamming 
window, and the 128-point periodograms are computed and averaged. Table | gives the numerical 
values of the power spectrum and autocovariance estimates for this example and Figure 2 is a plot of 
these values. 

POWER SPECTRUM 


21 
EXAMPLE 1 


de 


=a 
FREQUENCY IN Hz 


AUTO COVARIANCE 


VALUE 


LAG IN SAMPLES 
Fig. 2. Plots of the log power spectrum and the autocovariance for Example #1. 


This example should be compared to Example #1 of the program CMPSE of section 2.2 in this book. 
In that example a 63-point Hamming window was applied to the autocorrelation function. In this case a 
64-point Hamming window was applied to the data. According to Eq. (7) the spectral window for this 


2.1-4 


Section 2.1 PMPSE 


example is essentially the square of the spectral window for Example #1 of CMPSE. Thus the width of 
the main lob (between the first zeros) is almost the same but the side lobes are twice as low (in dB). A 
comparison of Fig. 2 of PMPSE and Fig. 3 of CMPSE confirms this assertion. 


POWER SPECTRUM 
24 


EXAMPLE 2 
2 
s 
~66 
‘5000 
FREQUENCY IN HZ 
i AUTO COVARIANCE 
s 
Al Se 4 a 
° 64 


LAG IN SAMPLES 
Fig. 3 Plots of the log power spectrum and the autocovariance for Example #2. 
Example #2 


For this example M = 128, IWIN = 1, L = 64, N = 256 and FS = 10000. That is, everything is the 
same as Example #1 except a rectangular window is used. The results are given in Table 2 and Fig. 3. 
Again, this example should be compared to Example #2 of CMPSE. 
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EXAMPLE 3 


FREQUENCY IN HZ 


AUTO COVARIANCE 


VALUE 


LAG IN SAMPLES 
Fig. 4 Plots of the log power spectrum and the autocovariance for Example #3. 
Example #3 


It should be noted that the FFT length M can be greater than or equal to the window length L. 
Obviously the greatest efficiency results when M = L, however if a more detailed representation of the 
spectrum is desired, M can be larger than L as in Examples #1 and #2. In this example, M = L = 
128, IWIN = 2, N = 256, and FS = 10000. In this case, about half as many segments are obtained 
from the 256 samples of data as in Example #1 (implying greater variance for a random signal) but the 
resolution is twice as good. The results are shown in Table 3 and Fig. 4. 
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WINDOW TYPE=HAMG 
P= 256 L= 64 SAMPLING FREQUENCY=10000.0000 


M= 128 WI 
XMEAN= 
LOG POWER 
FREQ 
+000 
312.500 
625.000 
937.500 
1250.000 
1562.500 
1875.000 
2187.500 
2500.000 
2812.500 
3125.000 
3437.500 
3750.000 
4062.500 
4375.000 
4687.500 
5000.000 


-69337E-06 
SPECTRUM 

DB FREQ 
-61,.4475 78.125 
-61.2347 390.625 
~67.5810 703.125 
19,1048 1015,625 
-21.7077 1328.125 
-64.6289 1640.625 
~64.0265 1953.125 
-66.7943 2265.625 
-69.3376 2578.125 
-71.4257 2890.625 
-73.1069 3203.125 
74.4394 3515.625 
-75.4666 3828.125 
-76.2405 4140.625 
76.7718 4453.125 
-77.0851 4765.625 
-77.1911 


CORRELATION FUNCTION 


LAG CORR 
0 .500 
5 -.483 
10 = =.435) 
15 -.366 
20 = .285: 


LAG CORR 
E 00 1 .404E 00 
IE 00 6 -.385E 00 
E00 11 .342E 00 
E 00 16 -.283E 00 
E00 21 .218E 00 
E 00 26 -.154E 00 
E00 31 .100E 00 
E-01 36 -.592E-01 
E-01 41 .311E-01 
E-01 46 -.143E-01 


50 .840E-02 51 .547E-02 


25 -.206 
30.136 
35 -.821 
40 .443 
45 -.210) 
55 -.267) 
60 .600: 


E-02 56 -.164E-02 
E-03 61 .319E-03 


Table 1 


DB 
~82.8421 
-86.3237 
-51.5461 

21.1584 
-89.0598 
-78.5597 
-82.6783 
-86.5093 
-89.5294 
-91.9038 
-93.7425 
-95.1747 
-96.2903 
-97.0862 
-97 .6216 
-97.9173 


FREQ 
156.250 
468.750 
781.250 

1093.750 
1406.250 
1718.750 
2031.250 
2343.750 
2656.250 
2968.750 
3281.250 
3593.750 
3906 .250 
4218.750 
4531.250 
4843.750 


LAG CORR LAG 
2 .154E 00 3 
7 -.144E 00 8 
12° .127E 00 13 
17 -.103E 00 18 
22 .780E-01 23 
27 -.544E-01 28 
32 .346E-01 33 
37 -.199E-01 38 

42  .102E-01 43 
47 -.449E-02 48 
52 .163E-02 53 
57 -.447£-03 58 
62 .630E-04 63 


2.1-6 


DB 
-61.3083 
-63.3791 

-9.4455 

16.3246 
-77.8186 
-63.1345 
-65 .3884 
-68.1207 
-70 .4361 
~72.3136 
-73.8075 
-74.9815 
-75 .8803 
-76.5297 
76.9536 
-77.1607 


CORR 


FREQ 
234.375 
546.875 
859.375 

1171,.875 
1484.375 
1796.875 
2109.375 
2421.875 
2734.375 
3046.875 
3359.375 
3671.875 
3984 .375 
4296.875 
4609.375 
4921.875 


DB 
-83.4551 
-92.0066 

9.7459 

3.5110 
-78 .8845 
80.5152 
84.6962 
~88.1117 
-90.7871 
-92.8826 
-94.5249 
-95.7766 
-96.7128 
-97.3865 
97.7954 
-97.9708 


LAG CORR 
-.153E 00 4 -.396E 00 
+141E 00 9 .362E 00 
-.122E 00 14 ~-.308E 00 
-984E-01 19 .244E 00 
-.733E-01 24 -.179E 00 
-504E-01 29 .121E 00 
-.316E-01 34 -.742E-01 
«179E-01 39 .411E-01 
--904E-02 44 -.200E-01 
~393E-02 49 .834E-02 
-.141E-02 54 -.281E-02 
«~384E-03 59 ,.697E-03 
-.490E-04 64 .000E 00 
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WINDOW TYPE=RECT 


M= 128 WI 
XMEAN= 


FREQ 

+000 
312.500 
625.000 
937.500 
1250.000 
1562.500 
1875.000 
2187.500 
2500.000 
2812.500 
3125.000 
3437.500 
3750.000 
4062.500 
4375.000 
4687.500 
5000.000 


P= 


-23. 
-20. 
“11. 

19. 

4. 
-17. 
24. 
-29, 
-32. 
-35. 
~37. 
-38. 
-39. 
-40. 
40. 
-41. 
41. 


256 


DB 
4182 
7564 
7112 
2009 
5159 
9894 
9423 
4704 
7145 
1528 
0285 
4782 
5853 
4053 
9695 
3003 
4096 


Table 2 


L= 64 SAMPLING FREQUENCY=10000.0000 
+69337E-06 
LOG POWER SPECTRUM 


FREQ 
78.125 
390.625 
703.125 
1015.625 
1328.125 
1640.625 
1953.125 
2265.625 
2578.125 
2890.625 
3203.125 
3515.625 
3828.125 
4140.625 
4453.125 
4765.625 


CORRELATION FUNCTION 


LAG CORR 


0 .499E 00 
5 -.460E 00 
10 .421E 00 
15 -.382E 00 
20 .343E 00 
25 -.304E 00 
30 .265E 00 
35 -.226E 00 


40 .187 


E 00 


45 -.148E 00 


50 .109) 
55 -.696) 
60 .306: 


E 00 
E-01 
E-01 


LAG 
1 
6 

1 
16 
21 
26 
31 
36 
41 
46 
51 
56 
61 


WINDOW TYPE=HAMG 
M= 128 NP= 


XMEAN= 


FREQ 
.000 
312.500 
625.000 
937.500 
1250.000 
1562.500 
1875 .000 
2187.500 
2500.000 
2812.500 
3125.000 
3437.500 
3750.000 
4062.500 
4375.000 
4687.500 
5000.000 


-80. 
-77. 
-70. 

18. 
66. 
-67. 
-73. 
-77. 
-80. 
-82. 
-84. 
-85. 
-86. 
-87. 
-88. 
-88. 
-88. 


CORR 
«397E 
-.365E 
«334E 
-.302E 
-271E 
-+239E 
«207E 
-.176E 
.144E 
-.113E 


.178E- 


01 


DB 
41.2622 
-37.5837 
-26.7759 

23.7835 
-29.0914 
-40.3775 
46.7622 
-51.0590 
54.1828 
-56.5475 
58.3657 
-59. 7669 
-60 .8339 
-61.6092 
62.1289 
-62.4118 


FREQ 
156.250 
468.750 
781.250 

1093.750 
1406.250 
1718. 750 
2031.250 
2343.750 
2656.250 
2968.750 
3281.250 
3593.750 
3906.250 
4218.750 
4531.250 
4843.750 


LAG CORR LAG 
2 .149E 00 3 
7 -.136E 00 8 
12 .124E 00 13 
17 -.112E 00 18 

22 .100E 00 23 
27 -.882E-01 28 
32 .761E-01 33 
37 -.641E-01 38 
42 .520E-01 43 
47 -,399E-01 48 
52 .279E-01 53 
57 -.158E-01 58 
62 .371E-02 63 


Table 3 


DB 
-22.7620 
-17.2393 

-2.5602 

12.2942 
-12.6625 
-21,.8953 
-27.4133 
-31.2150 
-34.0158 
-36.1508 
-37.8000 
-39.0701 
-40.0286 
-40.7173 
41.1630 


FREQ 
234.375 
546.875 
859.375 

1171.875 
1484.375 
1796.875 
2109.375 
2421.875 
2734 .375 
3046.875 
3359 .375 
73671.875 
3984 .375 
4296.875 
4609.375 


DB 
-40.0745 
-33.4572 
-14.1903 
-17,9184 
35.7182 
-43.9277 
-49.0958 
-52.7352 
-55.4436 
-57.5154 
-59..1143 
-60. 3393 
61.2544 
-61,8999 
~62.2989 


-41.3821 4921.875 -62.4676 


CORR 
-.148E 
«136E 
-.124E 
-112E 
- .997E- 
-876E- 
-.755E- 
.~635E- 
-.514E- 
.393E- 
-.272E- 
.152E- 
-.310E- 


LAG CORR 
00 4 -.379E 00 
00 9 .348E 00 
00 14 -.316E 00 
00 19 .284E 00 
01 24 -.253E 00 
01 29 .221E 00 
01 34 -.190E 00 
01 39 .158E 00 
01 44 -.126E 00 
01 49 .948E-01 
01 54 -.632E-01 
01 59 .316E-01 
02 64 -.358E-06 


256 L= 128 SAMPLING FREQUENCY=10000.0000 
-69337E-06 
LOG POWER SPECTRUM 


DB 
3770 
1878 
8606 
2261 
6186 
9136 
4819 
4638 
4112 
6574 
4137 
7784 
8187 
6011 
1343 
4489 
5555 


FREQ 
78.125 
390.625 
703.125 
1015.625 
1328.125 
1640.625 
1953.125 
2265.625 
2578.125 
2890.625 
3203.125 
3515.625 
3828.125 
4140.625 
4453.125 
4765.625 


CORRELATION FUNCTION 


LAG CORR 
0 .500 
5 -.496 

10 = =.484) 
15 -.464 
20 .438: 
25 -.406! 
30 = .371 
35 -.334) 
40 .296. 
45 -.259) 
50 .225 
SS -.194) 
60 .168 


E 00 
iE 00 
E 00 
E 00 
E 00 
E 00 
E 00 
iE 00 
E 00 
IE 00 
E 00 
E 00 
E 00 


LAG 
1 
6 

11 
16 
21 
26 
31 
36 
41 
46 
51 
56 
61 


CORR 
.404E 
-.399E 
.388E 
-.370E 
-347E 
-.319E 
-287E 
-.253E 
-218E 
-.181E 
.145E 
-.110E 


-769E-| 


00 
‘01 


DB 
-80.1718 
~-75.5785 
-72.1690 

26.8289 
63.7224 
-69.4777 
-74.6040 
-78.2804 
-81.0218 
-83.1414 
-84.7733 
-86. 0466 
-87.0359 
-87.7457 
-88.2224 
-88. 4872 


FREQ 
156.250 
468.750 
781.250 

1093. 750 
1406.250 
1718. 750 
2031.250 
2343.750 
2656.250 
2968.750 
3281.250 
3593.750 
3906.250 
4218.750 
4531.250 
4843.750 


LAG CORR LAG 
2 .154E 00" 3 
7 -.1S51E 00 8 
12 .146E 00 13 
17 -.138E 00 18 

22 .127E 00 23 
27 -.114E 00 28 
32 .981E-01 33 
37 -.800E-01 38 
42 .595E-01 43 
47 -.368E-01 48 
52 .117E-01 53 
57 .157E-01 58 
62 -.452E-01 63 


21-7 


DB 
-79.5365 
-73.8205 
-91 .4820 

5.4495 
-64.6737 
-70.9325 
-75 .6304 
-79.0422 
-81.6119 
-83.5880 
85.1392 
-86.3405 
-87.2378 
-87.8939 
88.3248 
-88.5287 


CORR 
-.154E 
.152E 
-.147E 
.141E 
-.134E 
+127E 
-.121E 
+116E 
-.114E 
-115E 
-.121E 
-131E 
-.147E 


FREQ 
234.375 
546.875 
859.375 

1171.875 
1484.375 
1796.875 
2109.375 
2421.875 
2734.375 
3046,875 
3359.375 
3671.875 
3984 .375 
4296.875 
4609.375 
4921.875 


DB 
78.5186 
-72.0789 
-34,5527 
-65.6636 
66.2602 
72.2612 
-76 .5837 
-79.7445 
-82.1475 
-84.0101 
-85.4598 
-86.5748 
-87.4188 
-88.0162 
-88.3804 
-88.5380 


LAG CORR 
00 4 -.402E 00 
00 9 .394E 00 
00 14 -.380E 00 
00 19 .361E 00 
00 24 -.337E 00 
00 29 .312E 00 
00 34 -.285E 00 
00 39 .259E 00 
00 44 -.235E 00 
00 49 .215E 00 
00 54 -.199E 00 
00 59 .190E 00 
00 64 -.187E 00 
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1. Purpose 


This program can be used to provide an estimate of either the autocorrelation function of a signal, 
or the cross-correlation between two signals using FFT techniques. An estimate of the power spectrum 
of the signal (obtained by computing the discrete Fourier transform of a windowed version of the corre- 
lation function) is also obtained in the program. 


1.1 Method 
The program is an implementation of the procedure originally described by Rader [1]. Figure 1 
shows a block diagram of the signal 
xin) USE FFT TO 


COMPUTE Ray (my, OS MsL-1 Syy (k) 
y(n) ESTIMATES OF ay 
CORRELATION FUNCTION wim 


WINDOW USED TO 
DUCE EFFECTS 
‘OF USING A 

FINITE LENGTH 
RECORD 


Fig. 1 Block diagram of the correlation method of power spectrum analysis. 


processing within the program. In the general case there are two input signals, x(m) and y(n), which 
are defined for the interval 0 < n < N — 1. Outside this interval it is assumed that x(n) and y(n) are 
0. We wish to compute the correlation function 


N-l-m 
Rylm) = YE" Celn)-RG(n+m)-7) OS mE L=1, () 
n=0 
where Xand jare the estimated means of x(n) and y(n), i.e., 

mg 
x=] zee (2a) 
= ees 
ied DSA ie (2b) 


The program offers the option of subtracting the estimated means or not. If the means are subtracted 
an estimated covariance function is obtained. If the means are not subtracted, an estimated correlation 
function is obtained. For simplicity we shall use the term correlation function for both cases unless this 
would lead to confusion. Since, in general, N >> L, i.e., the number of samples of the signal is large 
compared to the number of correlation lags of interest, an efficient procedure for implementing Eq. (1) 
is to use FFT methods to accumulate partial correlation sums (being careful to avoid the aliasing effects 
of the circular correlation from the FFT), and then inverse transform the result to give the desired 
correlation function. Details of this procedure are given in Refs. [1-3]. It should be noted that for this 
method if the size of the FFT is M points, then M/2+1 values of the correlation function are obtained. 
Thus, the FFT size must be at least twice the desired number of correlation values, L. 
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To obtain the power spectrum estimate from the correlation function one of two procedures is used. 
If y(n) = x(n), ie., the correlation is an autocorrelation (autocovariance), the windowed autocorrela- 
tion function, R,,(m), is created as 


Ry(m) = Ry.(m) w(m) O0<m<L-1 
‘x (M—m) w(M—m) M-L+1l<gm<M-1 
=0 otherwise (3) 


where w(m) is a symmetric finite duration window which tapers R,,(m) to 0 as m tends to L — 1. 
Equation (3) shows that R,,(m) is a symmetric function so that the resulting DFT of the sequence of 
Eq. (3) is a real function which is a smoothed estimate of the power spectrum S,.(e/”). 


If y(n) # x(n), i.e., the correlation is a cross-correlation (cross-covariance), the signal Ry,(m) is 
created as 


Ry =Ry(m)w(m) OS m<L-1 
=0 otherwise (4) 


where w(m) again represents a finite duration window. In general w(m) is a rectangular window since 
the "origin" of R,,(m) need not be at m = 0; thus arbitrarily tapering R,,(m) to 0 can lead to errone- 
ous estimates of the cross power spectrum. [For further discussion of this important issue see Ref. 2, 
p. 409-410]. The cross power spectrum estimate is again obtained as the DFT of the sequence of Eq. 
(4). 


2. Program Description 
The program flow is shown in Fig. 2. 


READ IN 
ANALYSIS 
PARAMETER 


M,N, MODE, FS 


WINDOW 
RESULTING 
CORRELATION FUNCTION! 


COMPUTE ESTIMATE 
OF POWER SPECTRUM 


Fig. 2 Flow diagram of program, CMPSE. 


IWIN, L, NFFT 


First the program reads in the parameters for performing the correlation analysis, namely the section 
size (FFT size), M, the total number of samples used in the estimate, N, and the type of correlation 
desired, i.e., autocorrelation, cross-correlation, autocovariance, or cross-covariance (as determined by 
the variable MODE). If a covariance function is desired, the next step is calculation of the means of 
x(n) (and possibly y(n)) using the user provided subroutine(s) GETX (and GETY) which fill buffers 
with a block of samples of x(n) (and y(n)) from a prescribed starting sample. (For simplicity we 
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assume the N samples of x() are numbered from 1 to N). Following computation of the means, the 
correlation function of Eq. (1) is determined by proper sectioning of x(m) into blocks of M samples 
which overlap by M/2 samples. The implementation of Eq. (1) is done by computing M-point FFT’s of 
the individual sections of x(n) (and y(n)), accumulating sums in the frequency domain (for computa- 
tional efficiency), and inverse transforming the final result back to the time domain. 


Following the correlation computation the program prints the first (M/2+1) correlation values. To 
obtain a power spectrum estimate, window parameters are then read in and the appropriate windowed 
correlation function (either Eq. (3) or Eq. (4)) is computed. The window parameters are window type 
(IWIN - either rectangular or Hamming), window duration (L), and size of FFT used to obtain the 
spectral estimate (NFFT). The program then prints out the log spectral estimate in dB. 


2.1 Usage 


The program consists of a main program (CMPSE), two user supplied subroutines (GETX and 
GETY) for accessing blocks of data, and a complex FFT subroutine (FFT). The main program reads in 
the appropriate parameters for the analysis, and the program computes the correlation function and 
prints its values, and from this array it computes an estimate of the log power spectrum (dB), and 
prints its values. Since the FFT subroutine is a radix 2 complex FFT, the section size must be a power 
of 2. Although no graphical capability is provided with the program, it is suggested the user insert 
appropriate graphics displays at the points denoted in the program to facilitate use of the program. Typ- 
ical graphical output is shown in the examples with this program description. 


2.2 Description of Program Parameters 
The main program reads the following parameters: 


M Section size. M must be an integer that is a power of 2 (for compatibility with the FFT subrou- 
tine) and M must be less than or equal to a maximum section size MAXM as specified in the 
main program. (For this program MAXM is set to 512). Note that M/2+1 must be greater 
than or equal to the total number of lags desired. 


N Total number of samples of x(n) (and y(n)) used in the analysis. It is assumed that samples 
of x(n) and y(n) are numbered from 1 to N. (Note: For computers with 16-bit integer word 
lengths, N must be less than 32768.) 


MODE Parameter which determines the type of correlation to be computed. 


MODE =0_ Autocorrelation 
MODE =1 Cross-correlation 
MODE =2  Autocovariance 
MODE =3 _ Cross-covariance 
FS Sampling frequency in Hz. 7 
IWIN Type of window used on correlation function. If IWIN = 1 a rectangular window is used; if 
IWIN = 2 a Hamming window is used. 


L Number of correlation points used in estimating the power spectrum. L must be less than or 
equal to M/2+1. 

NFFT FFT size (power of 2) used to compute spectral estimate from windowed correlation. NFFT 
must be greater than or equal to 2*L — 1. 


The user must supply the two routines GETX and GETY which provide values of x(n) and y(n) to 
the main program. The calls to these routines are 
CALL GETX (X,NRD,SS) 
CALL GETY (Y,NRD,SS) 
where the parameters X, Y, NRD, and SS are 


Xx Array in which the samples of x(n) are stored 


¥ Array in which the samples of y() are stored 
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NRD Number of samples of x(n) (or y(n)) to be read into array X (or Y) 


SS Starting sample number of x(n) (or y(n)), i.e., samples x(SS) to x(SS + NRD — 1) are read 
into array X in the subroutine GETX. Note that SS is a floating point number to allow for max- 
imum flexibility. The first input sample is assumed to be x(1), ie., SS = 1. 


The main program, CMPSE, and test subroutines GETX and GETY are given in the Appendix. 
The subroutine FFT is a complex FFT subroutine with calling sequence CALL FFT(X,M,INV), where 


M = Size of FFT (a power of 2) 
X = Complex array of length M. 
INV = 0 for direct FFT 
= 1 for inverse FFT 


2.3. Dimension Requirements 


The real array XA and the complex array X are dimensioned to size MAXM, where MAXM is the 
largest size FFT to be used in any run. The array XA is a data buffer and the array X is the working 
array for the FFT computation. The complex array Z is used to accumulate the transform of the corre- 
lation estimate. The real array XFR is used to generate a frequency scale corresponding to the DFT 
sample frequencies; the real array ILAG is used to generate a set of lag indices for printing. The arrays 
Z, XFR, and ILAG are dimensioned to (MAXM/2+1). 


2.4 Summary of User Requirements 


(1) Provide the subroutines GETX and GETY which specify x(m) and y(m) for the analysis to be 
performed. (For accessing data from a disk file, etc., the user must perform any necessary initiali- 
zation for reading the file.) 


(2) Provide the complex FFT subroutine FFT. 


(3) Specify the correlation parameters M, N, MODE, and FS, and the spectrum estimation parameters 
IWIN, L, and NFFT. 


(4) Provide a graphical output to plot the correlation function and/or the power spectrum estimate. 


; POWER SPECTRUM 
1 
EXAMPLE 1 


de 


“725 
FREQUENCY IN HZ 


AUTO COVARIANCE 


VALUE 


LAG IN SAMPLES 
Fig. 3 Plots of the log power spectrum and the autocovariance for Example #1, using a 
Hamming window. 


3. Test Problems 
To illustrate the use of this program a simple test problem is provided in which 
x(n) = cos(27n/10) 
and 
y(n) = sin(27n/10) 
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These sequences are sinusoids with frequency FS/10., where FS is the sampling frequency. 


Example #1 


For this example the program parameters are M = 128, N = 256, MODE = 2, FS = 10000, and the 
correlation parameters are IWIN = 2 (Hamming window), L = 32, and NFFT = 128. The numerical 
output of this example (i.e., the first M/2 + 1 points of the correlation function, and the M/2 + 1 
points of the log power spectrum) are given in Table 1. Figure 3 shows the autocovariance function 
and the log power spectrum for this example. Note the slight linear taper in the autocovariance func- 
tion estimate. This is due to the fact that only a finite number (256) of samples were used in the esti- 


mate. 


POWER SPECTRUM 
23 


EXAMPLE 2 
8 
Be eee eee ol ae ee ee 
° ‘5000 
FREQUENCY IN HZ 
1 AUTO COVARIANCE 
i 
aap 
° e4 


LAG IN SAMPLES 
Fig. 4 Plots of the log power spectrum and the autocovariance for Example #2, using a 
rectangular window. 

Example #2 

For this example M = 128, N = 256, MODE = 2, FS = 10000, IWIN = 1 (rectangular window), L 
= 32 and NFFT = 128. The numerical results are in Table 2, and Figure 4 shows the autocovariance 
function and log power spectrum. A comparison of Figs. 3 and 4 shows the well known fact that the 
Hamming window has a "main lobe" about twice as wide as the same size rectangular window, but much 
lower side lobes. 
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FREQUENCY IN HZ 


AUTO COVARIANCE 


VALUE 


LAG IN SAMPLES 


Fig. 5 Plots of the log power spectrum and the autocovariance for Example #3, using the 
same parameters as Example #2 except NFFT = 512. 
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Example #3 


This case is identical to Example #2, except the FFT size, NFFT, was 512 instead of 128. Figure 5 
shows the autocovariance and log power spectrum and Table 3 gives the numerical results, Note that a 
much smoother looking plot is obtained. However, it is well to point out that this is not a more accu- 
rate representation of the true spectrum, but rather a more detailed representation of the estimate of the 
spectrum. 


POWER SPECTRUM 


17 


EXAMPLE 4 | 


de 


FREQUENCY IN HZ 


CROSS COVARIANCE 


VALUE 


“1 L n 4 =I EN 
64 
LAG IN SAMPLES 


Fig. 6 Plots of the log power spectrum and the cross-covariance for Example #4 using a 
rectangular window. 


Example #4 


For this example M = 128, N = 256, MODE = 3, FS = 10000, IWIN = 1, L = 32, and NFFT = 
128. The numerical results are in Table 4, and Figure 6 shows the cross-covariance function and log 
power spectrum. Note that y(n) = x(n—2.5) so that R,,(m) should be roughly the same as the auto- 
covariance function of Example #2 but shifted to the right by 2.5 samples. This assertion is supported 
by a comparison of Figs. 4 and 6 with an allowance for the slightly different linear tapering and the half 
sample shift (interpolation). 


POWER SPECTRUM 


o 
s 
EXAMPLE 5 
FREQUENCY IN Hz 
AUTO COVARIANCE 
1.00 
w 
S 
z 
s 
0.035 128 


LAG IN SAMPLES 
Fig. 7 Plots of the log power spectrum and the autocovariance for Example #5. 
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Example #5 


CMPSE 


For this example the signal generators were programmed to provide samples of a white Gaussian 
noise (program not provided). Figure 7 shows plots of the power spectrum and autocovariance for the 
noise with the following parameters: 


M = 256, 
IWIN = 


A variation of about 5 dB is seen in the power spectrum for this theoretically white noise input. 


2, L=1 


N = 4096, 


MODE = 2, 


FS.= 


00, NFFT = 1024. 
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256 MODE=2 SAMPLING FREQUENCY=10000.0000 
-69337E-06 YMEAN= 


CORRELATION FUNCTION 


M= 128 N= 
XMEAN= 
LAG CORR 
0 .502E 
5 -.492E 
10 .482E 
15 -.473E 
20 .463E 
25 -.453E 
30 .443E 
35 -.434E 
40 .424E 
45 -.414E 
50 .404E 
55 -.395E 
60 .385E 


WINDOW TYPE=HAMG NO OF WINDOW VALUES= 


LAG 
00 4 
00 6 
oo 11 
00 16 
oo 21 
00 26 
oo 31 
00 36 
00 41 
00 46 
oo 51 
00 56 
oo 61 


CORR 
-403E 00 
-.395E 00 
«387E 00 
-.379E 00 
-371E 00 
--363E 00 
-356E 00 
-.348E 00 
-340E 00 
-.332E 00 
»324E 00 
-.316E 00 
+308E 00 


LOG POWER SPECTRUM 


FREQ DB FREQ 

+000 -21.4636 78.125 
312.500 -21.1400 390,625 
625.000 -29.4239 703.125 
937.500 17.1393 1015.625 
1250.000 -.5387 1328.125 
1562.500 -38.4645 1640.625 
1875.000 -29.6829 1953.125 
2187.500 -30.1628 2265.625 
2500.000 -31.0733 2578.125 
2812.500 -31.8905 2890.625 
3125.000 -32.5535 3203.125 
3437.500 -33.0708 3515.625 
3750.000 -33.4647 3828.125 
4062,500 -33.7648 4140.625 
4375.000 -33.9483 4453.125 
4687.500 -34.0617 4765.625 
5000.000 -34.0996 


Table 1 


-69337E-06 


LAG CORR LAG 
2 .151E 00 3 
7 -.148E 00 8 
12 .145E 00 13 
17 -.142E 00 18 

22 .139E 00 23 
27 -.136E 00 28 
32 .133E 00 33 
37 -.130E 00 38 

42 .127E 00 43 
47 -.124E 00 48 
52  .121—E 00 53 
57 -.118E 00 58 

62 .115E 00 63 


DB 
-52.2094 
36.8481 
711.0793 

18.1234 
-17.6599 
~25.3551 
-29.4415 
-32,3922 
34.7852 
-36.8850 
-38 .8437 
-40.7724 
~42.7547 
44.9129 
-47.4943 
-50.7562 


FREQ 
156.250 
468.750 
781.250 

1093.750 
1406.250 
1718.750 
2031.250 
2343.750 
2656 .250 
2968.750 
3281.250 
3593.750 
3906.250 
4218.750 
4531.250 
4843.750 
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CORR 
.153E 


LAG CORR 
-.156E 00 4 -.401E 00 


00 9 .393E 00 


--150E 00 14 -.386E 00 


-147E 


00 19 .378E 00 


--144E 00 24 -.370E 00 


~141E 
-.138E 
«135E 
-.132E 
.129E 
-.126E 
+123E 


00 29 .362E 00 
00 34 -.354E 00 
00 39 .346E 00 
00 44 -.338E 00 
00 49 .330E 00 
00 54 -.322E 00 
00 59 .314E 00 


--120E 00 64 -.307E 00 


DB 
21.9584 
-24.2275 

3.9527 
15.8463 
-32.1351 
-24,1909 
-26.0121 
-27.7101 
-29.0482 
-30.0797 
-30.8688 
-31.4660 
31.8997 
-32.2154 
-32.4179 
-32.5142 


32 FFT SIZE= 128 


FREQ 
234.375 
546.875 
859.375 

1171.875 
1484.375 
1796.875 
2109.375 
2421.875 
2734.375 
3046.875 
3359.375 
3671.875 
3984 .375 
4296.875 
4609.375 
4921.875 


DB 
-51,.8096 
-38.4634 

12.6998 

9.9801 
-42.3509 
-36.6632 
38.0924 
-39.9763 
-41.9843 
-44.1559 
-46.6298 
-49. 6887 
-54.1556 
-62.3889 
-67.1280 
-55.6432 


Spectrum Analysis 


Table 2 


Chapter 2 


LAG CORR 
00 4 -.401E 00 
oo 9 .393E 00 
00 14 -.386E 00 
00 19 .378E 00 
00 24 -.370E 00 
00 29 .362E 00 
00 34 -.354E 00 
00 39 .346E 00 
00 44 -.338E 00 
00 49 .330E 00 
00 54 -.322E 00 
00 59 .314E 00 
00 64 -.307E 00 


FREQ DB 
234.375 -18.6579 
546.875 -8.5367 
859.375 5.4016 
1171.875 -.3154 
1484.375 -6.8817 
1796.875 -10.5720 
2109.375 -13.2565 
2421.875 -15.4983 
2734.375 -17.5438 
3046.875 -19,5409 
3359.375 -21.6114 
3671.875 -23.8939 
3984.375 -26.6121 
4296.875 -30.1657 
4609.375 -35.8501 
4921.875 -55.6854 


LAG CORR 
00 4 -.401E 00 
00 9 .393E 00 
00 14 -.386E 00 
00 19 .378E 00 
00 24 -.370E 00 
00 29 .362E 00 
00 34 -.354E 00 
00 39 .346E 00 
00 44 -.338E 00 
00 49 .330E 00 
00 54 -.322E 00 
00 59 .314E 00 
00 64 -.307E 00 


M= 128 N= 256 MODE=2 SAMPLING FREQUENCY=10000.0000 
XMEAN= -69337E-06 YMEAN= -69337E-06 
CORRELATION FUNCTION 
LAG CORR LAG CORR LAG CORR LAG CORR 
0 .502E 00 1 .403E 00 2 .151E 00 3 -.156E 
5 -.492— 00 6 -.395E 00 7-.148E 00 8 .153E 
10 .482E 00 11 .387E 00 12 .145E 00 13 -.150E 
15 -.473E 00 16 -.379E 00 17 -.142— 00 18 .147E 
20 .463E 00 21 .371E 00 22 .139E 00 23 -.144E 
25 -.453E 00 26 -.363E 00 27 -.136E 00 28 .141E 
30 .443E 00 31 .356E 00 32 .133E 00 33 -.138E 
35 -.434E 00 36 -.348E 00 37 -.130E 00 38 .135E 
40 .424E 00 41 .340E 00 42 .127E 00 43 -.132E 
45 -.414E 00 46 -.332E 00 47 -.124E 00 48 .129E 
50 .404E 00 51 .324E 00 52 .121E 00 53 -.126E 
55 -.395E 00 56 -.316E 00 57 -.118E 00 58 .123E 
60 .385E 00 61 .308E 00 62 .115E 00 63 -.120E 
WINDOW TYPE=RECT NO OF WINDOW VALUES= 32 FFT SIZE= 128 
LOG POWER SPECTRUM 
FREQ DB FREQ DB FREQ DB 
+000 1.2468 78.125 -29.4088 156.250 1.4597 
312.500 2.2787 390.625 -13.7690 468.750 3.6083 
625.000 6.1146 703.125 -4.2923 781.250 9.9020 
937.500 21.3157 1015.625 23.4804 1093.750 17.7880 
1250.000 7,8799 1328.125 -2.6845 1406.250 4.0424 
1562.500 +7215 1640.625 -8.0628 1718.750 -1.1020 
1875.000 -3.0762 1953.125 -11.3458 2031.250 -4.1793 
2187.500 -5.5376 2265.625 -13.8561 2343.750 -6.2616 
2500.000 -7.2606 2578.125 -16.0150 2656.250 -7.7504 
2812.500 -8.5133 2890.625 -18.0259 2968.750 -8.8449 
3125.000 -9.4416 3203.125 -20.0211 3281.250 -9.6594 
3437.500 -10.1332 3515.625 -22.1209 3593.750 -10.2649 
3750.000 -10.6436 3828.125 -24.4750 3906.250 -10.7068 
4062.500 -11.0124 4140.625 -27.3203 4218.750 -11.0175 
4375.000 -11.2583 4453.125 -31.1973 4531.250 -11.2142 
4687.500 -11.4010 4765.625 -37.8602 4843.750 -11.3097 
5000.000 -11.4473 
Table 3 
M= 128 N= 256 MODE=2 SAMPLING FREQUENCY=10000.0000 
XMEAN= -69337E-06 YMEAN= -69337E-06 
CORRELATION FUNCTION 
LAG CORR LAG CORR LAG CORR LAG CORR 
0 .502E 00 1 .403E 00 2 .151E 00 3 -.156E 
5 -.492— 00 6 -.395E 00 7-.148F 00 8 .153E 
10 .482E 00 11° .387E 00 12 .145E 00 13 -.150E 
15 -.473E 00 16 -.379E 00 17 -.142E 00 18 .147E 
20 .463E 00 21 .371E 00 22 .139F 00 23 -.144E 
25 -.453E 00 26 -.363E 00 27 -.136E 00 28 .141E 
30 .443E 00 31 .356E 00 32 .133E 00 33 -.138E 
35 -.434E 00 36 -.348E 00 37 -.130E 00 38 .135E 
40 .424E 00 41 .340E 00 42 .127E 00 43 -.132E 
45 -.414E 00 46 -.332E 00 47 -.124E 00 48 .129E 
50.4048 00 51 .324E 00 52 .121E 00 53 -.126E 
55 -.395E 00 56 -.316E 00 57 -.118E 00 58 .123E 
60 .385E 00 61 .308E 00 62 .115E 00 63 -.120E 


2.2-8 


Section 2.2 


WINDOW TYPE=RECT NO OF WINDOW VALUES= 


LOG POWER. SPECTRUM 


FREQ 
-000, 
78.125 
156.250 
234.375 
312.500 
390.625 
468.750 
546.875 
625.000 
703.125 
781.250 
859.375 
937.500 
1015.625 
1093.750 
1171.875 
1250.000 
1328.125 
1406 .250 
1484.375 
1562.500 
1640.625 
1718.750 
1796.875 
1875.000 
1953.125 
2031250 
2109, 375 
2187.500 
2265. 625 
2343.750 
2421.875 
2500.000 
2578.125 
2656 .250 
2734.375 
2812.500 
2890.625 
2968.750 
3046.875 
3125 .000 
3203.125 
3281.250 
3359.375 
3437.500 
3515,625 
3593.750 
3671.875 
3750 ..000 
3828.125 
3906.250 
3984.375 
4062.500 
4140.625 
4218.750 
4296.875 
4375.000 
4453.125 
4531.250 
4609. 375 
4687 .500 
4765. 625 
4843.750 
4921.875 
5000.000 


DB 
1.2468 
-29.4091 
1.4597 
-18.6578 
2.2787 
-13.7696 
3.6082 
-8.5368 
6.1145 
-4.2924 
9.9019 
5.4015 
21.3156 
23.4803 
17.7879 
~.3156 
7.8799 
2.6846 
4.0424 
-6,8825 
+7213 
-8.0630 
-1.1022 
-10.5722 
-3.0764 
-11,3459 
4.1794 
-13.2568 
-5.5379 
-13.8558 
-6.2616 
-15.4986 
-7.2606 
16.0152 
-7.7503 
-17.5443 
8.5133 
18.0261 
-8.8449 
-19.5414 
-9.4415 
-20.0215 
-9.6594 
-21.6124 
-10.1334 
-22.1191 
-10.2642 
-23.8953 
-10.6426 
~24.4769 
-10.7036 
-26.6516 
-11.0178 
-27.3146 
-11.0190 
-30.1636 
-11.2594 
-31.1956 
-11.2151 
-35.8500 
11.4021 
~37.8505 
-11.3103 
-55.6846 
-11.4473 


FREQ 
19.531 
97.656 

175.781 

253.906 

332.031 
410.156 
488.281 

566.406 
644.531 

722.656 
800.781 

878.906 

957.031 
1035. 156 
1113.281 
1191. 406 
1269.531 
1347.656 
1425.781 
1503. 906 
1582.031 
1660.156 
1738 .281 
1816. 406 
1894 .531 
1972.656 
2050.781 
2128.906 
2207.031 
2285. 156 
2363.281 
2441.406 
2519.531 
2597. 656 
2675.781 
2753.906 
2832.031 
2910.156 
2988 .281 
3066. 406 
3144.531 
3222.656 
3300.781 
3378.906 
3457.031 
3535.156 
3613.281 
3691.406 
3769.531 
3847.656 
3925.781 
4003.906 
4082.031 
4160.156 
4238.281 
4316.406 
4394.531 
4472.656 
4550.781 
4628.906 
4707.031 
4785.156 
4863 .281 
4941.406 


Table 3 
(Continued) 


DB 

5363 
-6. 2786 
5815 
-4.5225 
1.2555 
-2.5548 
2.4343 
+4372 
4.9176 
4.0842 
8.6839 
12.5802 
22.5856 
22.8817 
14.3761 
6.5389 
5.1494 
2.5766 
1.5587 
-1.1278 
1.8174 
2.8873 
-3.5264 
~5.0576 
-5.5508 
-6.1529 
6.5441 
-7.7161 
-7.9203 
8.4974 
-8.5254 
9.7425 
79.5116 
-10.3452 
9.8752 
-11.4013 
-10.6013 
-11.8908 
-10.8027 
-12.8282 
-11.3450 
-13.2412 
-11.4318 
-14.1040 
-11.8391 
-14.4615 
-11.8403 
-15.2804 
-12.1432 
-15.5995 
12.0761 
-16.4137 
712.3111 
-16.6869 
-12.1907 
-17.4862 
12.3462 
-17.7521 
-12.1842 
-18.5720 
-12.2841 
-18.8174 
12.0794 
-19.6813 


FREQ 
39.063 
117.188 
195.313 
273.438 
351.563 
429.688 
507.813 
585.938 
664.063 
742.188 
820.313 
898.438 
976.563 
1054.688 
1132.813 
1210.938 
1289.063 
1367.188 
1445 .313 
1523.438 
1601 .563 
1679.688 
1757 .813 
1835.938 
1914.063 
1992.188 
2070.313 
2148.438 
2226 .563 
2304. 688 
2382 .813 
2460.938 
2539.063 
2617.188 
2695 .313 
2773.438 
2851 .563 
2929.688 
3007 .813 
3085.938 
3164 .063 
3242.188 
3320.313 
3398.438 
3476 .563 
3554. 688 
3632.813 
3710.938 
3789 .063 
3867.188 
3945.313 
4023.438 
4101 .563 
4179.688 
4257.813 
4335.938 
4414.063 
4492.188 
4570.313 
4648.438 
4726 .563 
4804.688 
4882.813 
4960.938 


2.2-9 


32 FFT SIZE= 


DB 
-1.8771 
-1,2692 
-2.1197 

-.0885 
-1.7014 

1.5086 

- -8658 

4.1519 

1.5109 

7.7845 

4.7616 
16.6793 
23.3390 
21.7985 

9.0283 

8.7332 

~ .3682 

4.6145 
-3.5401 

1.1186 
7.3252 

+7555 
-8.7360 
-2.8045 
-11.0350 
-3.9632 
-11.7173 
-5.4064 
-13.2446 
6.2116 
13.5218 
-7.3215 
-14.5631 
-7.9171 
14.5964 
-8.8176 
715.3110 
-9.2751 
-15.1929 
-10.0339 
-15.6803 
-10.3931 
-15.4669 
-11.0511 
-15.7942 
-11.3354 
-15.5175 
-11.9186 
-15.7255 
-12.1444 
-15.4008 
-12.6827 
-15.5407 
-12.8508 
-15.1891 
-13.3337 
-15.2424 
-13.4668 
14.8704 
-13.9152 
-14.8699 
-14.0055 
-14.4738 
-14.4257 


512 


FREQ 
58.594 
136.719 
214.844 
292.969 
371.094 
449.219 
527.344 
605.469 
683.594 
761.719 
839.844 
917.969 
996.094 
1074.219 
1152.344 
1230.469 
1308.594 
1386.719 
1464 .844 
1542.969 
1621.094 
1699.219 
1777344 
1855. 469 
1933.594 
2011.719 
2089.844 
2167,969 
2246.094 
2324.219 
2402.344 
2480.469 
2558.594 
2636.719 
2714.844 
2792.969 
2871 .094 
2949.219 
3027.344 
3105. 469 
3183 .594 
3261.719 
3339.844 
3417.969 
3496.094 
3574.219 
3652.344 
3730.469 
3808.594 
3886.719 
3964 .844 
4042.969 
4121.094 
4199.219 
4277 .344 
4355.469 
4433.594 
4511.719 
4589.844 
4667.969 
4746 .094 
4824.219 
4902.344 
4980.469 


DB 
-7.5362 
+9062 
-8.7002 
1.8659 
-9.2323 
3.3086 
-10.1205 
5.8471 
8.7443 
9.5558 
-14,9990 
19.4202 
23.6304 
20.1520 
-2.9158 
9.0190 
-23.3834 
4.9980 
-21.2599 
1.6235 
-43.7521 
~.2531 
-31.1360 
-2.2432 
-75.4598 
-3.3955 
~34.9787 
-4.7792 
~45.5196 
-5.5614 
-33.8661 
-6.6007 
-37.0923 
-7.1583 
-31.3533 
-7.9756 
32.4305 
-8.3826 
-28.9483 
-9.0455 
-29.2885 
-9.3441 
26.8918 
-9.8941 
-26.9421 
-10.1094 
25.1417 
-10.5723 
-25.0527 
-10.7210 
-23.5957 
-11.1259 
23.4887 
-11.2141 
-22.2846 
-11.5516 
-22.0957 
-11.5964 
-21.0559 
-11.8858 
-20.8460 
-11,8830 
-19.9108 
-12.1289 


CMPSE 


Spectrum Analysis Chapter 2 
Table 4 

M= 128 N= 256 MODE=3 SAMPLING FREQUENCY=10000.0000 
XMEAN= -69337E-06 YMEAN= -12023E-01 
CORRELATION FUNCTION 
LAG CORR LAG CORR LAG CORR LAG CORR LAG CORR 

0 -.286E-05 1 .293E 00 2 .472E 00 3 .470E 00 4 .289E 00 

5 -.427E-04 6 -.287E 00 7 -.462E 00 8 -.461E 00 9 -.284E 00 
10 -.588E-05 11 .281E 00 12 .453E 00 13 .451E 00 14 .278E 00 
15 -.396E-04 16 -.276E 00 17 -.444E 00 18 -.442—E 00 19 -.272E 00 
20 -.903E-05 21 .270E 00 22 .435E 00 23 .433E 00 24 .266E 00 
25 -.374E-04 26 -.264E 00 27 -.425E 00 28 -.423E 00 29 -.261E 00 
30 -.120E-04 31 .258E 00 32 .416E 00 33 .414E 00 34 .255E 00 
35 -.341E-04 36 -.253E 00 37 -.407E 00 38 -.405E 00 39 -.249E 00 
40 -.150E-04 41 .247E 00 42 .397E 00 43 .396E 00 44 .243E 00 
45 -.310E-04 46 -.241E 00 47 -.388E 00 48 -.386E 00 49 -.238E 00 
50 -.168E-04 51 .235E 00 52 .379E 00 53 .377E 00 54 .232E 00 
55 -.291E-04 56 -.230E 00 57 -.370E 00 58 -.368E 00 59 -.226£ 00 
60 ~.199E-04 61 .224E 00 62 .360E 00 63 .358E 00 64 .220E 00 
WINDOW TYPE=RECT NO OF WINDOW VALUES= 32 FFT SIZE= 128 
LOG POWER SPECTRUM 

FREQ DB FREQ DB FREQ DB FREQ DB 
-000 -9.1759 78.125 -1.5696 156.250 1.7312 234.375 -6426 

312.500 -6.4814 390.625 -2.4477 468.750 3.7055 546.875 4.7017 
625.000 -.0136 703.125 -1.1016 781.250 9.8122 859.375 14.5282 
937.500 16.7107 1015.625 17.1139 1093.750 15.8456 1171.875 12.5509 
1250.000 5.6713 1328.125 -19.9616 1406.250 2.0385 1484.375 3.3798 
1562.500 -.6206 1640.625 -17.6371 1718,750 -3.7983 1796.875 -1.0490 
1875.000 -3.8123 1953.125 -15.7870 2031.250 -7.6562 2109.375 -3.9764 
2187.500 -5.8886 2265.625 -15.2234 2343. 750 -10.5349 2421.875 -6.1414 
2500.000 -7.3826 2578.125 -15.0337 2656.250 -12.7978 2734.375 -7.8359 
2812.500 -8.5120 2890.625 -14.9642 2968.750 -14.6178 3046.875 -9.2064 
3125.000 -9.3852 3203.125 -14.9200 3281.250 -16.0888 3359.375 -10.3365 
3437.500 -10.0635 3515.625 -14.8582 3593.750 -17.2664 3671.875 -11.2788 
3750.000 -10.5840 3828.125 -14.7564 3906.250 -18.1832 3984.375 -12.0686 
4062.500 -10.9704 4140.625 -14.6016 4218. 750 -18.8550 4296.875 -12.7286 
4375.000 -11.2367 4453.125 -14.3844 4531.250 -19.2999 4609.375 -13.2785 
4687,500 -11.3933 4765.625 -14.0969 4843.750 -19.5210 4921.875 -13.7311 


5000.000 -11.4447 


2.2-10 


CMPSE 


Section 2.2 


NVSWA ‘NVEWX (8866'Ld1) JLTUM 
(//) LvWaos 
(6866'La1) SLUM 
(NVGWA ‘NVZWX)X1aWO = NWX 
NVSWX = NVSWA (Z°O3"aGOW) 4T 
)4VOT4/WOSK = NVSWA 
(N)LVOTZ/WOSX = NVBWX 
BONILNOD 04 
(GuN)ivola + ss = ss 09 
SONIINOD 0S 
(1)vx + WOSA = WOSK 
qUN'L=I 0g oa 
(ss ‘aun ‘¥x)ALg9 TIVD 
09 OL 09 (Z*Da"aGOW) aI 
SQNIINOD 0F 
(1)vx + wosx = wosx 
GUN'L=I OF Od 
(Ss ‘GUN ‘VX)XIa9 TIVO 
GUN* (1-4) - N= GUN (LOESN"O"'X) aI 
DOgSN*L=% OL OG 


6866 


2 
SONVIUVA SSOUD 4I YOLVHINSO A WOWd SHIdWVS GUN GVSY OL ALED asn 9 
SS @IdWVS LV ONIUYVIS HOLVHSNSD X WOUd SI4WVS GUN GvaY OL XLaD JsN 2 
Vivd A ONY X dO SNVEW 3LVINOIVD OL dO0O1 2 
Fe) 
"0 = WOSK 
“oO = wosx 
L4HS1 = GUN 
‘Les ss 
2 
GaLNdWOD 3a OL LNdLNO HOLVEANSD 40 S@IdWVS dO HAGWON SI GUN OD 
WaGWON @IdNVS HOLVYINED SI SS 9 
2 
08 OL OD (Z°LI"aGOK) aT 
(vOld *=AONaHS . 
“MOGYd ONITWVS HOL ‘LI ‘=3GOW HL ‘SI ‘=N Hb ‘PI ‘=W HE) LYWYOd 0666 


Sa ‘SQOW ‘N ‘W (0666°Ld1) 3LIUM 
(p'Old) LVWYOd 1666 
Sd (1666*ILL) avaw 


(=(p°014)ZH NI AQNANOAMA ONTTANVS HEE) LVHYOd 7666 
(2666*OLL) BLUM 

(11) avwyoa £666 
GOW (€666°ILL) avau 

(=(11)3d0W HOL) Ivwyoa 666 
(666°OLL) 3LTEM 

2 


GvWuO4 ad4L Viva 3GOW NI avau 5 

2 

(L4HS1)LVOTA/ (* t- (LaHST)LYOTd+ (N)LVOTA) = LOASN 
| + daHsT = LaTHW 

@/W = LaHST 


(=(¥I)9ZIS NOILO’S HBL) LvWHOa 6666 
(6666°OLL) 3LIUM 07 


N‘W SUSLEWVYVd SISAIVNY NI avay 2 


SQNILNOD Ot 
t- 1 = (r)ovar 
HXVW'L=I OL od 


ONIGNIYd HOd AVY OVI TILG 2 


L + Z/WXVW = HXVW 
tis = WXVW 
(Z)HOWWLI = Lat 
(P)HOWWLT = OLL 
(L)HOWWIT = ILL 


(Za) ZINN Lnazno 
GU4VGNVLS SHL NO NSLLIYM SI LnaLno TIV :Lndino 


“MSMSNV SHL NI S3dA% WSS 3HL GNV (OLL) ‘IVNIWNSL 
4aSN SHI NO N3LLIUM SI NOTLSANO V - SI LVHL 
SAILOVUSINI-W3SN SI WWHDOUd SIHL OL LNANI :LNaNI 
Sad09 SOIAgd O/I aNIaaq 


vuuvovuvvuuy 


/OHL'WHE'WHE'HHL/ (p°Z)NIMC *(€*Z)NIMC *(Z*Z)NIMC ‘(L*Z)NIMC Viva 
ATH OHL'SHL'MHL/ (P'E)NTME “(E*L)NTMC *(Z*L)NTMC ‘(L*L)NIMC viva 
OLL ‘ILL YsOaLNI 

IA *IX *NWX *(4SZ)Z ‘(Z1S)X XBTaHOO 

(4s@)9VII NOISNaWIG 

(p'2)NIMC NOISNAWIG 

(4s@)uax *(Z1S)¥X NOISNEWIG 


oo 


WV4OOUd SLVNIWNSL 0 = GWI 
NOY MN 1 = GWI 
SNOY IVNOILIGGY SLSanosd aWI 
WXVW => Jd4N => 7 
SLVWILSS IVULOadS SHL SAID OL GaSN dad AZIS AHL SI Laan 
W=> 1 => Zz 
@LVWIISE ‘IVulogds aHL 
NI G3SN SAN IVA NOILVIaHYOD 4O UAWAN GHL SI 1 
MOGNIM ONIWAVH = Z = NIMI 
MOGNIM UVINONVLOTY = = NIMI 
SdAL MOGNIM 3HL SI NIMI 
ZH NI AQNSNOGYA ONITAWVS HL SI sad 


SONVIYVAOD SSOHD £ = 3GOW 

SONVINVAOD OLNV Zz = adOW 
NOILV1SUYOD SSOHD | = GOW 
NOILYTSHYOD OLNY 0 = aGOW 
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A Coherence and Cross Spectral Estimation Program* 


G. Clifford Carter and James F. Ferrie 


Naval Underwater Systems Center 
New London, CT 06320 


1. Purpose 


This program can be used to estimate various second order statistics between two real sequences. In 
particular the auto and cross power spectral density functions together with coherence and generalized 
cross correlation functions can be estimated. 


2. Method 


The method uses the overlapped fast Fourier transform (FFT) technique discussed by Carter, Knapp 
and Nuttall [1]. The method discussed is sometimes referred to as the direct method (as opposed to 
the indirect correlation methods) and has been discussed in part by Welch [2], Bingham, Godfrey and 
Tukey [3], Benignus [4], Nuttall [5], Williams [6], and more fully by Carter, Knapp and Nuttall [1]. 


The method begins with two (one from each process) digital waveforms (or with analog waveforms that 
have been lowpass filtered and digitized). Briefly, there are four steps in the estimation procedure: 
First, each time series is segmented into N segments, each having P data points. Second, each segment 
is multiplied by a smooth weighting function. Third, the z transform of the weighted P-point sequence 
is evaluated on the unit circle in the z-plane. Finally, the discrete Fourier coefficients obtained in the 
third step are used to estimate the elements of the power spectral density matrix by averaging "raw" 
power spectral estimates over all the N segments. A summary flow chart is given in Figure 1. 


More explicitly, two random processes that are jointly stationary over N data segments are processed as 
follows (Carter and Knapp [7]): 


1. Each of the two time series is segmented into N segments of P points. The segments may either be 
disjoint or overlapped. Then one segment of P data points with the same (or aligned) time origin is 
selected from each of two time records. Even if each of the N data segments is large, P should be 
selected to ensure that the sampling frequency divided by P will afford sufficiently fine spectral resolu- 
tion. 


2. Each of the two P point segments is multiplied by a smooth weighting function. Here smooth means 
that as many higher order derivatives be continuous as reasonable over the full interval of data points. 
The smoother the weighting function, the more rapidly the side lobes of its Fourier transform, or win- 
dow function, will decay, and thus the less leakage there will be extraneous power, which corrupts spec- 
tral measurements. Hence, smooth weighting functions result in better spectral estimates. Smooth 
weighting functions however, result in poorer frequency resolution when Pis held fixed. If better reso- 
lution is desired, more data points per segment will be required. From a stability point of view, 
increasing P decreases the available number of independent data segments when the data duration is 
finite. 


The application of some smooth weighting function, has been shown to be necessary to reduce errors 
due to side lobe leakage. (Carter and Knapp [7]). However, weighting functions have the apparent 
disadvantage of wasting the available data. This apparent wastage can be overcome through the added 


* This program, originally written and documented by C. R. Arnold, G. C. Carter, and J. F. Ferrie, has been rewritten and 


tested by J. C. Sikorski, G. C. Carter, R. G. Williams, and J. F. Ferrie. U.S. Government Work not protected by U.S. 
copyright laws. 
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‘START 


NNN - NUMBER OF DATA 
POINTS (P) PER SEGMENT 


ISR - SAMPLING RATE (Hz) 


aso ner oe asm NOSJP - NUMBER (N) OF DISJOINT 
(NON OVERLAPPED) SEGMENTS 


READ INPUT 
PARAMETERS 


SFX, SFY - DATA SCALE FACTORS 
USUALLY SET EQUAL TO UNITY 


READ A SEGMENT 
OF 2-CHANNEL DATA FROM 
MAGNETIC TAPES 


MULTIPLY DATA SEGMENT 
BY COSINE BELL 


COMPUTE NNN 
POINT FFT OR 
PAM-C2T 


BACKSPACE 
DATA TAPES 
ACCORDING TO 
PERCENTAGE OVERLAP 
DESIRED 


ESTIMATE SPECTRAL 
DENSITY MATRIX 


UPDATE RUNNING 
SUM OF ESTIMATE 


‘No 


COMPUTE MAGNITUDE-SQUARED 
COHERENCE ESTIMATES 
PRINT INPUT PARAMETERS AND RESULTS, 


Fig. 1 Summary flow chart for coherence and spectral estimation program. 


cost of ‘overlapped processing. Nuttall [5] has shown that the same equivalent degrees of freedom can 
be obtained from a fixed amount of data via overlapped processing as with indirect correlation process- 
ing for both auto and cross spectral density estimation. 


3. The transform of the weighted P-point sequence is evaluated on the unit circle in the z plane. The 
two sided z-transform of an infinite sequence is defined by Oppenheim and Schafer [8] as 


X,(2) = YL x,(p)z%, 2 =1,2,...N, (1) 
po 
where z equals any complex variable. 
Similarly, Y,(z) is defined as the z-transform of y,(p). When x,(p) and y,(p) are finite in duration, 


the infinite series Eq. (1) becomes finite. Evaluation of the ztransform at P equally spaced points 
around the circle yields the discrete Fourier transform or DFT: 


X,(k) = > X,(p) eW/2#P/P (2) 
p=0 


Similarly, Y,(k) is the DFT of the n'” weighted data segment y,(p), p = 0, 1,...,P — 1. The DFT can 
rapidly be evaluated by the FFT. Having computed the DFT, Eq. (2), by an FFT, we are ready to 
proceed with the fourth step in the spectral estimation algorithm. 


4. The spectral estimates are 
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a N 
Ge(k) = cg Y 1X,(H/?, (3a) 

a= 

= N 
G,(k) = ce DYCK), (3b) 

n=l 

m N 
Gylk) = ce Y XK), (kK), (3c) 

aml 

with the constant gain 

WER (3a) 


J; = sampling frequency and * indicates complex conjugate. The estimate of magnitude squared coher- 
ence (MSC) 


: 1G(k) /? 
eee 
Cy (k) ZG,” (4) 


Without some understanding of the statistics of the estimator in Eq. (4) it would be of little practical 
value. Under certain assumptions the statistical characteristics of C can be evaluated. These charac- 
teristics are based on the derivation by Goodman [9] of an analytical expression for the probability den- 
sity function of the magnitude coherence estimate and the subsequent extensions to magnitude squared 
coherence by Carter, Knapp and Nuttall [1]. These results are based on two zero-mean stochastic 
processes that were jointly stationary, Gaussian, and had been segmented into N independent segments.! 
Each segment was assumed large enough to ensure adequate spectral resolution. Further, each segment 
was assumed perfectly weighted (windowed), in the sense that the Fourier coefficient at some fre- 
quency was to have "leaked" no power from other bins. The statistics do not hold at the zero-th or 
folding frequencies (Hannan [10]). Extensions to Goodman’s work are given by Haubrich {11], Net- 
theim [12], Wahba [13], Carter, Knapp and Nuttall [1], and Halvorsen and Bendat [14]. 


3. Program Description 


The main program estimates the auto and cross spectral density functions. The programs listed are 
intended to be general FORTRAN IV programs; they have been compiled and executed on the PDP- 
11/70, System Engineering Laboratory (SEL) 32/55, Univac 1108, Control Data Corporation (CDC) 
6600 and International Business Machine (IBM) 360. The spectral estimation programs have been used 
for research projects by: Williams [6], Brady [15], Carter, Knapp and Nuttall [1], Carter, Nuttall and 
Cable [16], Santopietro [17], Carter and Knapp [7] and Carter [18]. These research projects were con- 
ducted entirely on the Univac 1108 and a significant program rewrite was undertaken to make the pro- 
grams more transferable from one computer system to another. The programs as a complete data pro- 
cessing system consists of input, computations and display. We have concentrated our rewrite efforts 
on the computations; both the input and display programs are expected to contain peculiarities of the 
particular computer being used. The input and display subroutines are modular so that only a 
minimum rewrite is required to transfer the program to another installation. The function of the input 
subroutine LOAD is to load the XX and YY arrays each with a real data segment of P (equivalent to 
the FORTRAN variable NNN) data points. If the data were stored on logical magnetic tape number 6 
in binary format the call to LOAD could be replaced by the FORTRAN statement ‘ 


READ 6, XX(I), YY(I), I=1, NNN, 


The subroutine LOAD listed in the Appendix is used to generate synthetic data for a suitable test case. 
1. Despite the fact that it is mathematically tractable to obtain analytic expressions only when the segments are independent, we 
would in practice use some overlapped processing to regain the apparent data wastage incurred by the necessity of data 


weighting. Carter, Knapp and Nuttall [1] report the results of an empirical study that demonstrates how bias and variance 
decrease as a function of increased data segment overlap. Fifty percent overlap is recommended with cosine weighting. 
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The main program also calls (in addition to LOAD): COPLT, HICMP, FFT842, PRCES, PRPRT, 
LREMV and ZERO. The subroutine ZERO is used to store zeroes in an array. The subroutines 
PRPRT and COPLT are display subroutines. The subroutine LREMV estimates (and optionally 
removes) the linear trend and mean value for the input time waveforms. These computations are per- 
formed for every time segment and are printed out by the main program as in aid to detecting nonsta- 
tionarities or digitizing errors. 


The subroutine FFT842 computes the FFT (see, for example, Cooley and Tukey [19]) coded and 
listed by Bergland and Dolan [20]. FFT842 can be replaced with a different FFT program such as the 
mixed radix FFT of Singleton [21]. Note that the subroutine PRCES and the main program presume 
that the FFT output array is subscripted from 1 to NPFFT and not from 0 to (NPFFT-1), where 
NPFFT is the number of point FFT to be performed. 


The subroutine PRCES implements the generalized cross correlation functions discussed in Knapp and 
Carter [22]. The subroutine PRCES calls on the subroutines FFT842 and COPLT. Given the FOR- 
TRAN variable NNN, the subroutine HICMP finds the highly composite number closest to (but greater 
than or equal to) NNN. The output of HICMP is NEWNN. For FFT842, NEWNN is 2 to an integer 
power. (For Singleton’s FFT see Carter [18].) For some applications, the program user will want 
NEWNN to be twice as large as NNN; this is because the main program fills the data arrays with zero 
from NNN+1 to NEWNN. Such zero filling is (theoretically) required to inhibit the effect of circular 
convolution; in practice, though, (with stochastic data) zero filling often does not warrant the added 
computational cost. If it is desired, zero filling can simply be achieved by adding one line to HICMP: 
"NEWNN = 2*NEWNN". In addition to calling several critical subroutines, the main program per- 
forms computations necessary to estimate the spectral characteristics of the two waveforms under inves- 
ligation. 


When the two input waveforms are complex, one FFT of each waveform segment is required as 
specified in earlier. In most (though not all) practical data collection facilities, the input waveforms are 
real (not complex). When x(t) and y(t) are real, one FFT of the complex waveform x(t) + j y(t) 
can be computed and quickly be manipulated to form the FFT of x(1) and the FFT of y(t). (See pp. 
333-334 of Oppenheim and Schafer [8]; see also pp. 271-293 of Rabiner and Rader [23]). These obser- 
vations, combined with Eq. (3) give rise to the FORTRAN statements used to estimate the spectral 
characteristics of x(t) and y(r). The application of this theory reduces the computation time for two 
real waveforms by a factor of two. 


The final comment necessary before presenting the computer listings is to describe the input FOR- 
TRAN variables. NNN is the number of data points per segment. ISR is the integer sampling rate 
(Hz). NDSJP is the number of disjoint segments in the total time waveform. SFX and SFY are scale 
factors used to adjust the level of the input waveform to correct for frequency independent attenuations 
in the data collection and digitizing process. (When no correction is desired, the user sets 
SFX=SFY=1.0. When the user desires the spectral estimates to appear twice as large in power, he 
sets SFX=SFY=2.0.) With these five sample inputs, the input time data are processed, 


4. Test Problem 


The test problem was run with NNN = 32, ISR = 256, NDSJP = 8, SFX = 1.0 and SFY = 1.0. The 
LOAD subroutine used to generate the synthetic data is the one given in the Appendix. Selected out- 
put is given in the following tables. 
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NNN 


SFX 


= 32 ISR 


Table 1 
32 256 8 1.0 1.0 
Table 2 
= 256 NDSJP = 8 
SFY = 0.10000000E 01 


= 0.10000000E 01 
THE 8 DISJOINT PIECES COMPRISE 


NUMBER OF POINT FFT = 
PRINTOUT OF FIRST 50 VALUES OF INPUT DATA 


32 


1 0.92138798 3. 00000000 

2 -0.06441755 -0.12499915 

3 0.80970714 1.00000000 

4 -0.54630972 3.00000000 

5 1.00000000 3.00000000 

6 -0.25065174 3.00000000 

7 -1.00000000 1.00000000 

8 1.00000000 1.00000000 

9 1.00000000 1.00000000 
10 1.00000000 1.00000000 
11 -1.00000000 1.54018403 
12 -1.00000000 0 .83475567 
13 -1.00000000 1.34758016 
14 -1.00000000 1.00000000 
15 0.66246481 0.71841439 
16 0.44273215 2.02324235 
17 0.60807347 1.00000000 
18 -1.00000000 2.28788233 
19 0.39938986 0.08707205 
20 0.78639817 -0.00627428 
21 -1.00000000 0.76997684 
22 0.84838115 3.00000000 
23 -0.57563173 3.00000000 
24 -0.00635505 1.66902228 
25 -0.91894575 3.00000000 
26 1.00000000 0.16576968 
27 1.00000000 -0.10451246 
28 0 .69710672 1.00000000 
29 1.00000000 0.96631333 
30 -0.63129364 3.00000000 
31 -0.14878848 1.00000000 
32 -1.00000000 -0.12384148 


DX= 0.63539E-01 
0.69209E 00 vY= 
DX=-0.41329E-01 
0.74174E 00 vY= 
DX=-0.21002E-01 
0.69332E 00 vY= 
DxX= 0.41618E-01 
0.63633E 00 VY= 
DX= 0.10607E 00 
0.68438E 00 vY= 
DX=-0.55038E-01 
0.76118E 00 vY= 
DX=-0,12450E 00 
0.67879E 00 vY= 
DX= 0.41899E-01 
0.76327E 00 vY= 


AVERAGE VARIANCES ARE, 


DY= 0.14078E 
0.32296E 01 
DY= 0.12917E 
0.29968E 01 
DY= 0.14245E 
0.33341E 01 
DY= 0.14021E 
0.37315E 01 
DY= 0.14050E 
0.35066E 01 
DY= 0.12663E 
0.26802E 01 
DY= 0.13886E 
0.35007E 01 
DY= 0.13454E 
0.32313E 01 


01 SX=-0.69924E-02 
Mivaxeeeeoetos 
01 sxe-0.541 74-62 
01 8xe-0.961318-02 
mses 0.12152E-01 
Giuexs 0.47732E-02 
aivexeteleachietoz 


O 
01 SX=-0.15682E-01 
ti) 
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1.00 SECONDS OF DATA 


SY¥=-0.20702E-01 
SY=-0.16657E-01 
SY=-0.23483E-01 
SY=-0.67735E-02 
SY¥= 0.27676E-01 
SY¥=-0.69094E-02 
SY=-0.18342E-01 


SY=-0.15694E-01 


VX=0.706388E 00 VY=0.327634E 01 


INTEGRATED VARIANCES ARE, VX=0.751587E 00 VY=0.455639E 01 
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FMIN = -32 


INDEX 


13 
14 
15 
16 
17 


FREQ 

0. 
8.000 
16.000 
24.000 
32.000 
40.000 
48.000 
56.000 
64.000 
72.000 
80.000 
88.000 
96.000 
104.000 
112.000 
120.000 
128.000 


.49 DB 


DB 
-28.69 
-22.76 
-24.14 
-23.85 
-25.94 
23.66 
-23.82 
-30.54 
-28.08 
-22.88 
28.47 
-30.59 
32.49 
-24.22 
-23.31 
-30.09 
-28.35 
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Table 2 


(Continued) 


PEAK = 


-22.76 DB 


PLOT OF AUTOCORRELATION RXX 


FMIN =-0.17620937E 00 


TIME 
0. 
0.00391 
0.00781 
0.01172 
0.01563 
0.01953 
0.02344 
0.02734 
0.03125 
0.03516 
0.03906 
0.04297 
0.04688 
0.05078 
0.05469 
0.05859 
0.06250 


FMIN = -27 


FREQ 


8.000 
16.000 
24.000 
32.000 
40.000 
48.000 
56.000 
64.000 
72.000 
80.000 
88.000 
96.000 

104.000 
112.000 
120.000 
128.000 


VALUE 
1.0000 seeeee 
0.1584 seseee 


0.0703 
0.0385 
-0.0151 

0.0123 
-0.1025 

0.1921 
-0.1762 
-0.1458 

0.0042 

0.0480 

0.0086 
-0.1496 

0.0149 
-0.0865 


-0.1143 #¢ 


PEAK = 0.10000000E 01 


Prreeerrretrrcrrrrrrtrrririii rrr srr i rs) 
weteee 


PLOT OF AUTO SPECTRUM GYY 


-55 DB 


PEAK = 


-7.77 DB 


PLOT OF AUTOCORRELATION RYY 
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Table 2 
(Continued) 
PMIN = 0.18801017E 00 PEAK = 0.10000000E 01 
INDEX TIME VALUE 
1 . 1.0000 setenssassesesecssesseHsee sees ee eaneeeennasee 
2 0.00391 0.6667 sessescsessensssseneessces 
3° 0.00781 0.6123 seeesessseccessessessee 
4 0.01172 0.5594 ssusseuscenseussesss 
5 0.01563 0.5295 seeseessessassaces . 
6 0.01953 0.5461 sseseesecsesesesaes 
7 0.02344 0.4426 sssasscecesen 
8 0.02734 0.4713 sesenssansenses 
9 0.03125 0.3698 ssseee 
10 0.03516 0.3382 #+seseex 
11 0.03906 0.3196 sesseue 
12 0.04297 0.2811 « 
13 0.04688 0.2830 +++0s 
14 0.05078 0.2195 « 
15 0.05469 0.2356 «+ 
16 0.05859 0.2086 « 
17 0.06250 0.1880 « 
1 DUMP OF CONTINUOUS PHASE VALUES IN DEGREES 
FREQUENCY 
0. 0. 
8.000 46.59 
16.000 48.43 
24.000 139.80 
32.000 140.38 
40.000 244.10 
48.000 251.48 
56.000 297.47 
64.000 402.70 
72.000 413.14 
80.000 426.34 
88.000 486.45 
96.000 495.55 
104.000 610.33 
112.000 616.86 
120.000 637.78 
128.000 720.00 
1 DUMP OF THE MAGNITUDE SQUARED COHERENCE 
FREQUENCY 
3 0.02 
8.000 0.17 
16.000 0.46 
24.000 0.66 
32.000 0.42 
40.000 0.51 
48.000 0.66 
56.000 0.33 
64.000 0.05 
72.000 0.60 
80.000 0.49 
88.000 0.54 
96.000 0.44 
104.000 0.66 
112.000 0.73 
120.000 0.08 
128.000 0.13 
1 
PLOT OF CROSS SPECTRUM GXY 
FMIN = -34.40 DB PEAK = -21.84 DB 
INDEX FREQ DB 
%:, C0; -27.20 #0 
2 8.000 -21.84 sssees 
3 16.000 -24.21 seuss 
4 24.000 -23.92 esses 
5 32.000 -26.28 ses 
6 40.000 -24.05 seses 
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(Continued) 


7 48.000 -23.99 sasee 
8 56.000 -29.45 +* 
9 64.000 -32.38 + 
10 72.000 -24.10 s#ss« 
11 80.000 -28.93 #« 
12 88.000 -29,30 #* 
13° 96.000 -31.14 « 
14 104.000 -23.76 ssses 
15 112.000 -23.44 sees* 
16 120.000 -34.40 + 
17 128.000 -31.74 * 


PLOT OF SCOT FUNCTION 


FMIN =-0.27144101E 00 PEAK = 0.10000000E 01 


INDEX TIME VALUE 
-15 -0.05859 -0.0367 sssseues 
-14 -0.05469 0.0685 
-13 -0.05078 -0.0173 
-12 -0.04688 -0.0309 
-11 -0.04297 -0.0413 

-10 -0.03906 -0.0666 
-9 -0.03516 0.0150 eenseneens 

-8 -0,03125 -0.1832 se« 

-7 -0.02734 -0.0906 ssese« 

~6 -0.02344 -0.0721 seeeses 

-5 -0.01953  -0.1263 s#see 

=4 -0.01563 1.0000 seeseessennnseeneerenneeaasesseassneensenane 
-3 -0.01172 0.0884 seaeenseeees 

-2 -0.00781 -0.0508 
-1 
0 
2 
3 
4 
5 
6 
iz 
8 
L) 


-0.00391 0.0785 
0. -0.0964 
0.00391 ~-0.0254 seeseeee 
0.00781 0.0076 s#eneenee 
0.01172 0.1127 steseeeseonee 
0.01563 -0.2714 + 
0.01953 0.0138 
0.02344 0.0477 
0.02734 0.0947 
0.03125 -0.0031 seeseeeee 
0.03516 -0.2503 + 

10 0.03906 0.0520 seesseesene 

11 0.04297 -0.2190 « 

12 0.04688 -0.0850 eeesee 

13° 0.05078 0.1026 seeseeeeeeeee 

14 0.05469 0.0808 seseeceee 

15 0.05859 0.0955 sees aeee 

16 0.06250 0.0334 seseeeseee 


PLOT OF PHAT FUNCTION 


FMIN =-0.20107339E 00 PEAK = 0.10000000E 01 


INDEX TIME VALUE 
-15 -0.05859 -0.1132 ##* 
-14 -0.05469 0.0576 sesseeees 
-13 -0.05078 0.0087 #seeses 
-12 -0.04688 0.1063 tseeeeeeee 
-11 -0.04297 -0.0956 «#*+ 
-10 -0.03906 0.0106 tsaeeee 
-9 -0.03516 0.0342 s#ssene0 
-B -0.03125 -0.0108 seeese« 
-7 -0.02734 -0.1228 + 
-6 -0.02344 0.0016 sexeeee 
-5 -0.01953 -0.0710 s#s+ 
-4 -0.01563 1.0000 eeascensensecccssenssessscssesssasssesssnnsnd 
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-3 -0.01172 
-2 -0.00781 
-1 -0.00391 
0 oO. 
1 0.00391 
2 0.00781 
3 0.01172 
4 0,01563 
5 0.01953 
6 0.02344 
7 0.02734 
8 0.03125 
9 0.03516 
10 0.03906 
11° 0.04297 
12 0.04688 
13° 0.05078 
14 0.05469 
15 0.05859 
16 0.06250 


FMIN =-0.34397384E 00 


INDEX TIME 
-15 -0.05859 
-14 -0.05469 
-13 -0.05078 
-12 -0.04688 
-11 -0.04297 
-10 -0.03906 

-9 -0.03516 
-8 -0.03125 
-7 -0.02734 
-6 -0,02344 
-5 -0.01953 
-4 -0.01563 
-3 -0.01172 
-2 -0.00781 
-1 -0.00391 
0 0. 

1 0.00391 

2 0.00781 

3 0.01172 

4 0.01563 

5 0.01953 

6 -0.02344 

7 0.02734 

8 0.03125 

9 0.03516 

10 0.03906 

11. 0.04297 

12 0.04688 

13° 0.05078 

14 0.05469 

15 0.05859 

16 0.06250 


0.0834 
0.0005 
0.1309 
0.0364 
-0.0259 
0.0367 
0.1267 
0.1574 
0.0259 
-0.0032 
0.1261 
-0.0266 
-0.2011 
-0.0047 
-0.1278 
0.0534 
0.0720 
0.0483 
0.1496 
0.0708 


PLOT 


VALUE 
0.0363 
0.0346 
-0.0797 
0.0962 
0.1154 
-0.0943 
0.0692 
-0.0789 
-0.0351 
0.0645 
0.1599 
1.0000 
0.2454 
0.1985 
0.0785 
0.0137 
0.1357 
-0.0413 
0.2720 
0.3031 
0.1149 
0.0263 
0.0278 
0.0109 
-0.3440 
-0.0676 
-0.3070 
-0.2010 
0.0053 
0.0484 
-0,.0226 
-0.0096 


PLOT 


Table 2 
(Continued) 


peerererees 
peeeeers 

ste eenee sees 
sateneee 
seeeee 
seeeeeee 


erereerereres 
seesenes 
saeeeee 
teens 
teens 


sees 


weteeee 
- 


orrrerreres 


tteeeeeee 


OF CROSS CORRELATION 


ateeeee 


Serrrrerres 
Perr r rere rerrierrcrss 
. 

seeeeee 


Pereerrerrers 
+ 


prreeeresy 
sees 

ttt eeeeeaee 
sete eeeeee 


sae eeneeee 
sea eeeeeeee 


OF IMPULSE RESPONSE 


PEAK = 0.99999999E 


00 


FMIN =-0.21953384E 00 


INDEX TIME VALUE 
-15 -0.05859 -0.0803 sss 
-14 -0.05469 0.0746 #seneesee 
-13 -0.05078 0.0486 sttesseae 


PEAK = 0.10000000E 01 


. 
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-12 
“11 
-10 
-9 
-8 
-7 
-6 
-5 
-4 
-3 
-2 


PMIN =-0.41350540E 00 


INDEX 
715 
-14 
-13 
-12 
-11 
-10 

<9 
-8 


7 
-6 
<5 
-4 
-3 
-2 
“1 
0 
5 
2 
3 
4 
5 
6 
7 
8 
9 
10 
1 
12 
13 
14 
15 
16 


-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 

0. 
0. 
oO. 
0. 
oO. 
0. 
0. 
oO. 
0. 
0. 
0. 
0. 
Oo. 
Oo. 
0. 
0. 
0. 


-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
-0. 
oO. 
0. 
0. 
0. 
oO. 
oO. 
Oo. 
oO. 
0. 
0. 
o. 
0. 
0. 
0. 
oO. 
oO. 
oO. 


04688 
04297 
03906 
03516 
03125 
02734 
02344 
01953 
01563 
01172 
00781 
00391 


00391 
00781 
01172 
01563 
01953 
02344 
02734 
03125 
03516 
03906 
04297 
04688 
05078 
05469 
05859 
06250 


TIME 

05859 
05469 
05078 
04688 
04297 
03906 
03516 
03125 
02734 
02344 
01953 
01563 
01172 
00781 
00391 


00391 
00781 
01172 
01563 
01953 
02344 
02734 
03125 
03516 
03906 
04297 
04688 
05078 
05469 
05859 
06250 


0.0800 
-0.0617 
-0.0118 

0.1547 
-0.1106 

0.0197 

0.0170 
-0.0603 

1.0000 

0.1841 

0.0015 

0.1916 
-0.0267 

0.0846 

0.1157 

0.0311 
-0.1551 

0.1101 

0.0212 

0.0761 
-0.0276 
70.2195 

0.0860 
-0.1769 
-0.0984 

0.0904 

0.0731 

0.1506 

0.0278 


PLOT 


VALUE 
0.1616 
0.1164 
0.0293 
-0.2013 
0.0462 
-0.1862 
0.0473 
-0.2488 
-0.0879 
-0.0597 
-0.1886 
1.0000 
-0.0182 
-0.0176 
-0.0216 
-0.2124 
0.0345 
-0.1292 
0.2419 
-0.4135 
0.0438 
0.1171 
0.1649 
0.1535 
-0.3226 
0.1061 
-0.2780 
-0.0597 
0.0888 
0.0750 
-0.0103 
0.0463 


PLOT 


Table 2 
(Continued) 


peeerererres 
seaee 


aes 
peeeeeererrrss 
sees 

eeaseeee 
peeeeerss 


POEeeteteetitrrerrtrrrircrrcr rc tli rr errr) 
peeeeerrrrr rors 
tt aeeeee 


neeeneeee 
+ 
Poreererrrrey 


sees 
. 
Perererrrers 
. 

anes 
aeeeeee 


Perrerrrrry 
peeeererrrr ery 
Pereeeeery 


OF H-T(I) FUNCTION 


PEAK = 0.99999999E 00 


preeeeereres gy 


tteee 
aeaee 
Pere eee errterrrrrrrrs 


peeeeeeererres? 
Peeeeeeeertresrss 


Peeeeeeeertecrrss 


poeeeeeeerorssry 


aeeeeeee 


OF ECKART FUNCTION 
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Table 2 
(Continued) 
FMIN =-0.63544157E 00 PEAK = 0.10000000E 01 
INDEX TIME VALUE 
-15 -0.05859 0.5846 sesnssnsensesssensessssnsessceses 
-14 -0.05469 0.1941 sssesssensessesseceses 
-13 -0.05078 0.2290 susssesecsesesensecses 
-12 -0.04688 -0.5636 + 
-11 -0,04297 -0,3422 seseceee 
-10 -0.03906 -0.6354 + 
-9 -0.03516 -0.4095 
-8 -0.03125 -0.3856 
-7 -0.02734 -0.3801 
-6 -0.02344 0.2161 
-5 -0.01953 0.2143 sessasssssasscnssensons 
-4 -0.01563 1.0000 #eessenseesseesasesesesees 
-3 -0.01172 0.4729 
-2 -0.00781 0.4576 
-1 -0.00391 -0.0076 
0 oO. -0,1843 
1 0.00391 -0.0194 sensesneeesenses 
2 0.00781 -0,.3895 sssees 
3 0.01172 -0,0398 seeeeeeenees 
4 0.01563 -0.5450 «+ 
5 0.01953 0.0318 
6 0.02344 -0.0044 
7 0.02734 0.1967 
8 0.03125 0.1180 
9 0.03516 -0.3017 
10 0.03906 -0.0853 
11 0.04297 -0.3988 
12 0.04688 0.2159 
13 0.05078 -0.0369 
14 0.05469 0.2568 
15 0.05859 0.2253 «+ 
16 0.06250 0.3553 « 
1 PLOT OF THE TRANSFER FUNCTION 
FMIN = -8.64 DB PEAK = 2.97 DB 
INDEX FREQ DB 
1 = 2.97 
2 8,000 1.84 
3 16.000 -0.14 
4 24.000 -0.14 
5 32.000 -0.69 
6 40.000 -0.77 
7 48.000 -0.33 
8 56.000 2.18% 
9 64.000 -8.60 
10 72.000 -2.44 
11 80.000 -0.92 
12 88.000 2.60 
13 96.000 2.70 
14 104.000 0.91 
15 112.000 -0.26 see 
16 120.000 -8.64 + 
17 128.000 -6,78 + 
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CHAPTER 3 


Fast Convolution 


L. R. Rabiner 


Introduction 


The only program in this chapter is an implementation of a high speed (FFT) convolution as pro- 
posed by Stockham [1], and Helms [2]. The program was provided by J. Allen and is a direct imple- 
mentation of the method of overlap-add. The program is designed to handle efficiently large amounts 
of data assumed available on a file or disk. 
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FASTFILT -- An FFT Based Filtering Program 


Jont B. Allen 


Acoustics Research Dept. 
Bell Laboratories 
Murray Hill, NJ 07974 


1. Purpose 


FASTFILT is intended to be a general purpose utility program for filtering large amounts of data 
from disk. It consists of a MAIN program called FASTFILT and a subroutine RFILT which may be 
used independently if desired. The input data sequence is assumed to exist in a file on disk (as binary 
data). The function of FASTFILT is to sequentially read in blocked segments of data, filter them (by a 
call to RFILT), and store the results on disk in a second file. The filter is always represented by its 
impulse response. (A test program for RFILT called TESTFILT has also been provided.) 


2. Method 
The filter technique is the well known method of overlap-add [1,2]. 


3. Program Description 


When specifying the filter impulse response to FASTFILT the user may elect to either read a 
precomputed impulse response from disk or input an impulse response from the teletype terminal 
input. In the following, disk files will be given as names in quotations, i.e., "DISKFILEIN", "DKOUT". 
The teletype terminal name on input will always be represented as "TTYI" and the teletype name on 
output as "TTYO". 


When entering the filter impulse response data from "TTYI" the program recursively asks for delay 
and gain values. The delay requested IDEL is the index of the impulse response array sample 
F(IDEL). The gain value requested is the value of the impulse response at delay IDEL. For example 
if IDEL = 1024 and G = .8, then F(1024) = .8. Any delay values not specified will have zero gain. 
IDEL = 1 represents no delay, while a gain of one represents no gain change. When IDEL is set to 
zero, the loop is terminated and the impulse response F(I) is stored on disk in a file called "FILT- 
DATA", thereby making it available for subsequent use. The filter length must be a power of 2, but 
this represents no restriction of course, since one may append any number of zeros to the impulse 
response. 


The length of the filter, NP, is limited by the maximum FFT size NMAX. The length of the FFT 
used NPT2 must be twice as long as the impulse response, NP. Thus, NP < NMAX/2. The total 
array space required is two real arrays NMAX long and a real array NMAX/2 long. Thus the total 
space required is 5*NMAX/2 reals. If one real word is stored in two integer locations, the total integer 
array space required is therefore 5S*NMAX or 10*NP. These numbers assume that a real to complex 
FFT is used, such as Bergland’s FAST, FSST, or FFA, FFS (see section 1.2). On our Data General 
Eclipse, each user has 32K words of 16 bit core. In this case NMAX may assume a maximum of 4096 
and the maximum filter length NP is 2048 points. Under these conditions the total integer array 
requirement is 20,480 words (leaving 12,288 words for the program code.) 


1. If the user has a filter design package he wishes to use with this program he must compute the filter impulse response 
using his program and store it on disk. 
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It is an important fact that the amount of time to perform the filtering per sample of input data 
increases only as log)(NPT2), the logarithm base 2 of the FFT length. Since the disk overhead reads 
and writes usually decrease as NPT2 increases, the time required for filtering is nearly independent of the 
filter length. 


The first question asked by our program is the filter length. This question is asked in order to keep 
the size of files stored on disk as small as possible: if disk storage were not a consideration, a standard 
2048 long impulse response could be assumed with no significant loss in speed. 


3.1 Data 1/O 


This program has not been intended for a batch environment. (The batch user must use his own 
I/O and RFILT.) We assume that the user may respond to questions through keyboard input. 


Besides TTY I/O, it is necessary to read and write data from the disk. DISK I/O is done in one 
Routine DKIO. We assume that the user has named disk files and that commands are available to open 
named disk file on a FORTRAN channel for reading and writing. 


The subroutine DKIO must be supplied by the user. The arguments which must be supplied are (in 
order as they appear in the call) 


NAME = An array containing the name of the disk file to be accessed (defined by call GNAME) 
ICN = Fortran channel number of named file 

1B0 = Relative block number to be read or written 

IARRAY = Integer array for core data storage 

NBLK = Size of IARRAY, in disk blocks 

IER = Error Flag (not used here) 

IOPER = Operation Code 


The final argument determines the operation to be performed according to the following table 


Operation 


open disk file 
close disk file 
read from disk file 
write onto disk file 


Alternatively the user may rewrite the four calls FOPEN, CLOSE, RBLK, and WBLK. 


A remaining complication is that of reading the file names from the TTY keyboard. The problem is 
that a file name may be any number of characters long and thus some form of free format 
alphanumeric READ on "TTYI" must be available. In order to handle this we assume that the user has 
a subroutine called GNAME. When GNAME is called, the user types in a file name of any (reason- 
able) number of characters, and this name is returned in an array NAME, formatted so that it may be 
used directly when the file is opened. For example 


DIMENSION NAME (10) 
CALL GNAME(NAME) 
CALL DKIO(NAME,0....,0) 


opens FORTRAN channel 0 on the disk with a disk file name defined by the user in response to the 
GNAME call. 
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3.2. Speed 


The following times are for the DATA GENERAL ECLIPSE computer. Our 1024 point real FFT 
time is 288 (milliseconds, FFA time). The time required to filter 25,600 data points with a 2048 point 
filter is 40 sec. Thus 


time _ 40sec _ 17 Bs 

point 25600 "point 
These figures may be used to compensate for the speed of the FFT on the users machine by propor- 
tional adjustment of this time. 


3.3, Accuracy 

The accuracy will be close to the accuracy of the FFT (see Tables 4 and 5 of Section 1.0). 
3.4 RFILT 

Subroutine RFILT is called as follows 
CALL RFILT(R,F,S,NP) 


where S is a scratch array NP points long, F is the filter frequency response 2*NP+2 real (NP + 1 
complex) points long. R(1) to R(NP) are the input (prior to the call) and output data points (after 
return from the call), while R(NP+1) to R(2*NP) are data points left from the previous call to RFILT. 
Prior to the first call to RFILT, R(NP+1) through R(2*NP) should be zeroed. After the initial call to 
RFILT, this portion of R should not be changed in any way. The array S may be used in the main pro- 
gram for any purpose since it is only used as a temporary storage array. For example it may be 
EQUIVALENCE’d to an integer array for the disk read and writes. The array F is assumed to be the 
output of FAST (or FFA) corresponding to the filter input impulse response. The filter impulse 
response must be zero in the range of time samples n between NP+1 through 2*NP, i.e., the second 
half of F, prior to calling FAST (FFA). The user should study the listings for further details. 


3.5 FAST, FSST 


These FFT subroutines are those given in this book in Section 1.2. They may be replaced by FFA 
and FFS for greater speed. 


3.6 Further Constant Definitions Are: 


ITTO TTYO output channel number 

ITTI TTYI input channel number 

IDSKO, IDSK1 allowed disk channel numbers 

NBLKL length in words of minimum disk block size (power of 2 only). 
NMAX maximum FFT size allowed 

SCALE A positive number equal to the maximum magnitude of data to be 


stored or read from disk (This number may be D/A and A/D dependent). 
NP Filter length 


3.7 Required External Calls and Functions 

CALL GNAME CALL FAST CALL DKIO 
CALL FSST IILMACH 

4, Test Examples 


In the following examples, computer responses are in BOLD FACE while user responses are in 
ITALICS. Comments are in normal type. 


Example 1 


For the following dialogue we assume that the filter impulse response is on disk in a file named 
"FILTER". We wish to filter some speech data also on disk in file "SPEECHIN". The output, the 
filtered speech data, will go to disk file "DKOUT”. 
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DO YOU WISH TO DO FILTERING (=0) 
OR CORRELATION (MATCHED FILTERING) (=1) ? 
0 


PROGRAM WILL DO FILTERING 

FILTER LENGTH IN 256 WORD DISK BLOCKS (1,2,4,0R8) = 
8 

FILTER WILL BE 2048 POINTS LONG 

INPUT FILTER FROM DISK(1) OR TTY(2) = 
1 

FILTER FILENAME = 

FILTER 

SYSTEM GAIN = (F10.1) 

1. 

INPUT DATA FILENAME = 

SPEECHIN 

OUTPUT DATA FILENAME = 

DKOUT 

# OF DATA BLOCKS TO BE FILTERED = (15) 
00100 

STOP 


Example 2 


As a second example we input the filter impulse response from the keyboard. All other conditions 
remain the same. 


DO YOU WISH TO DO FILTERING (=0) 

OR CORRELATION (MATCHED FILTERING) (=1) ? 

0 

PROGRAM WILL DO FILTERING 

FILTER LENGTH IN 256 WORD DISK BLOCKS (1,2,4,0R8) = 
8 

FILTER WILL BE 2048 POINTS LONG 

INPUT FILTER FROM DISK(1) OR TTY(2) = 

2 


DELAY = 0 TO TERMINATE INPUT MODE 


DELAY = (14) 

0002 delay by one sample 
GAIN = (F10.1) 

-1. change sign of data 


DELAY = 0 TO TERMINATE INPUT MODE 
DELAY = (14) 

0000 

IMPULSE RESPONSE IS ON DISK IN FILE "FILTDATA" 
INPUT DATA FILENAME = 

SPEECHIN 

OUTPUT DATA FILENAME = 

DKOUT 

# OF DATA BLOCKS TO BE FILTERED = (15) 
00100 

STOP 


The data will be delayed by one sample and inverted as a result of these commands. 


5. TESTFILT 


TESTFILT is a main program written to test subroutine RFILT. It also provides an excellent test of 
the FFT routines. The program requires no input and upon completion prints a pass/fail message on 
the output device. It filters an internally generated function with the impulse response (0.,—1.,0.). It 
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then compares the result to the original input function, Required external routines are FAST, FSST, 
RFILT, I1MACH, and RIMACH. TESTFILT should be run before attempting to run FASTFILT. 


References 
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CHAPTER 4 


Linear Prediction Analysis of Speech Signals 


B.S. Atal 


Introduction 


Linear prediction is one of the most widely used techniques in speech analysis. It provides a simple 
and effective method of representing speech signals in terms of a small number of slowly-varying 
parameters. The linear predictability of speech signals is based directly on a linear filter model of 
speech production. In this model, the filtering properties of the glottal flow, the vocal tract, and the 
radiation at the lips are represented by a single time-varying all-pole filter. The linear prediction tech- 
niques provide a simple method for estimating the parameters of the all-pole filter. 


Linear prediction parameters have been found useful in a variety of applications, such as speech 
coding, speech recognition, speech synthesis, and speaker verification. Although the technique of 
linear prediction is applicable to a much broader class of signals, the programs presented in this section 
have developed from applications to speech signals. For applications to other classes of signals, great 
care must be exercised in choosing the right program and in the appropriate selection of the variables of 
the programs. Even for speech signals, there is still a large number of unresolved issues: How many 
predictor parameters should be used? What is the ideal analysis interval? Where should the analysis 
interval be located with reference to the pitch period? What is an ideal anti-aliasing filter for analog- 
to-digital conversion of the speech signal prior to LPC analysis? The answers to such questions often 
depend on the particular application for which the LPC analysis is used. However, it is fair to say that 
we still lack a clear understanding of the constraints which a physical signal must satisfy for the LPC 
analysis to work satisfactorily on that signal. 


The programs presented in this section are of two types: 1) a set of programs (AUTO, COVAR, 
CLHARM, and COVLAT) related to different methods of LPC analysis, and 2) another program, 
LPTRAN, that transforms one LPC representation to another. 


Several alternate ways of doing LPC analysis have evolved over the past ten years or so, mainly to 
take care of the complications introduced by the nonstationary nature of speech signals. For a nonsta- 
tionary signal, it is important to perform a "short-time analysis" [1] using short segments of the signal 
during which it could be considered to be nearly stationary. The differences in the various LPC analysis 
methods lie in the manner in which they treat the signal outside the analysis interval in the process of 
determining predictor coefficients. 


The correlations between different samples of a signal play a key role in the LPC analysis. All of 
the LPC analysis methods require that such correlations be computed in the process of determining 
LPC parameters. In the program AUTO (based on the autocorrelation method of LPC analysis), these 
correlations are expressed in terms of a short-time autocorrelation function [1,2]. This method requires 
that the signal be set to zero outside the analysis interval and a suitable window, such as a Hamming 
window [2], be used to reduce the abrupt change in signal values occurring at the beginning and at the 
end of the analysis interval. The use of an autocorrelation function leads to a particularly simple and 
efficient algorithm for determining LPC parameters. The program COVAR (patterned after the covari- 
ance method of LPC analysis) in the same section computes the LPC parameters by minimizing the 
mean-squared prediction error over the analysis interval. This method avoids truncation of the signal, 
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but does require that an entire matrix of covariances be computed from the speech signal. In its origi- 
nal form [3], this method did not always produce predictor coefficients which could be used for a later 
synthesis of the signal without producing unstable outputs. However, the program COVAR can be 
modified to produce a set of reflection coefficients, k,,ky, . - . , ky, which can be transformed to a set 
of predictor coefficients corresponding to a stable all-pole filter [4,5]. This transformation can be per- 
formed, if desired, by the program LPTRAN (to be discussed later). The programs COVLAT and 
CLHARM described in Sec. 4.2 follow a somewhat different approach to linear prediction based on the 
lattice structure of the all-pole filter. The lattice formulation does not need a knowledge of the short- 
time autocorrelation function for determining predictor coefficients and therefore avoids windowing of 
the signal. Also, the resulting all-pole filter is always stable. Thus, the lattice method may be prefer- 
able for certain applications. 


As expected, the LPC analysis produces accurate results if a signal has been generated as the output 
of an all-pole filter excited either by a delta function or white noise. However, it is rare that a physical 
signal can be modelled exactly as stated above. The performance of LPC techniques suffers whenever 
any one of the assumptions underlying the linear prediction model is violated. For example, in the 
prsence of spectral zeros (which could be introduced by the vocal tract, by the glottal excitation, or 
even by the anti-aliasing filter used in the A/D conversion), the linear prediction techniques not only 
skip over the spectral zeros but often introduce errors in formant frequencies and their bandwidths. 
The periodic nature of voiced excitation also introduces similar errors [3]. These errors must be kept 
in mind while interpreting the results of LPC analysis. 


There are several equivalent ways of describing the characteristics of an all-pole filter. The program 
LPTRAN described in Sec. 4.3 allows one to go from one representation to another in an efficient 
fashion. Although all these representations are equivalent and are uniquely related to each other, some 
of them may be more suitable than others for certain applications [2,3]. For example, the area function 
representation has been found to be well-suited for speech synthesis-by-rule applications where a con- 
tinuous speech message is created by concatenating and then smoothing a number of prestored ele- 
ments. Similarly, the cepstral parameters have been found to be most effective for speaker recognition 
tasks. Another important transformation is the set of partial correlation coefficients (PARCOR) or 
reflection coefficients. Table 1 of Sec. 4.3 lists the different LPC representations which can be 
transformed by LPTRAN. It should be noted that the transformations between alternate LPC represen- 
tations are valid only for all-pole filters. 
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Linear Prediction Analysis Programs (AUTO-COVAR) 


A. H. Gray, Jr. 


Department of Electrical Eng. & Computer Science 
University of California at Santa Barbara 
Santa Barbara, CA 93106 
and 
Signal Technology, Inc.* 


J. D. Markel 


“Signal Technology, Inc. 
15 De La Guerra Street 
Santa Barbara, CA 93101 


1. Purpose 

The purpose of these programs is to implement the autocorrelation (AUTO) and covariance 
(COVAR) methods of linear prediction analysis. 
2. COVARiance and AUTOcorrelation Methods 


Two cases will be treated here, commonly termed the covariance and autocorrelation methods. The 
Fortran subroutines which carry out the solution are called COVAR and AUTO. For derivations, 
detailed discussion, motivation, and references the reader is referred to [1]--only a summary of the 
algorithms is presented here. 


The general problem can be stated as follows. Given a data sequence {x(0),x(1),...,.x(N—1)} and 
an integer M, find the coefficients {a ,a,...,@,,) which minimize the summation 


lt M 
«=> [x(n) + YE ayx(n—k)]? . (1) 
n=N k=l 
This minimization is carried out by solving the equations 
M 
Z aick=— co for k=1,2,...M, (2) 
i=l 
where 
Li} 
CK = DY x(n—-i)x(n—-k) « (3) 
=m 


In the covariance method the limits 9 and n, are defined so that no data points {x(n)} outside of 
the range 0 < n < Nare needed for the evaluation of Eq. (3): 


no=M, nj=N-1. (4) 


In this case, the coefficient set {c,} forms a symmetric, positive semi-definite matrix. The matrix will 
be singular if the input data sequence {x(n)} satisfies a linear homogeneous difference equation of 
order M or less. 


In the autocorrelation method, the data sequence is treated as though it were zero outside of the 
interval from m = 0 through n = N — 1: 


x(n)=0 for n <0 andfor n >N-1 (AUTO). (5) 


In this case no and n, are defined as —co and +co respectively. The coefficient set {c,} forms the ele- 
ments of a symmetric positive definite Toeplitz matrix, and the coefficients can be expressed in terms 
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of an autocorrelation sequence as 
ce = 1 (li-k |) (AUTO) (6) 
where 
N=I-k 
r(k) = Y x(n)x(n+k) for k =0,1,...,.N (AUTO) . 7) 
n=0 
Only values of r(k) for k = 0, 1,...,M are needed for the solution. 
The two methods give identical results when the data sequence is truncated so that x(n) = 0 for 
n < Mand for n > N —1—M. The two methods give similar results when N >> M. 
3. The Algorithms 


The subroutine COVAR implements a form of Cholesky decomposition, and the subroutine AUTO 
implements a form of Robinson’s recursion. As many of the steps are common to both, a common 
notation is used in this discussion. 


3.1 Initialization (step zero) 


For COVAR Egs. (3) and (4) are applied directly to obtain the covariance coefficients co9, cio, and 
cy. For AUTO all of the correlation coefficients are obtained by directly applying Eq. (7), though only 
r(0) and r(1) are needed for initialization: 


Coo = Cy, = (0) and cy =r(l) (AUTO). 


The following parameters are then defined: 


ao = 1, bn = 1, 

a = Coo, Bo = ens 
ky =—-¢1o/en, 

ay = 1, a= ky 
a = a — ki Bo 


3.2 Recursion (step m for m=1,2,....M—l) 


For COVAR, ¢y,41,0 is directly evaluated from Eq. (3) and Eq. (4). The coefficients c,,4),, for 
k = 1,2,...,m+1 are found from 


Cm+ik = Cmk—1 + X¥(M—m-1)x(M—k) — x(N-—m-1)x(N-k) 
For AUTO, the correlation sequence {r()} is was evaluated in the initialization step. 
For COVAR, one evaluates then 


Ym = ak X m+.) ony for n=0,1,....m—1, (8a) 
Bn ist ; 
by =— Ym by for jf =1,2,...m, (8b) 
i=j-l 
eee lee, (8c) 
m+i 
Ba = ZL Cmts On « (8d) 
j=l 
While these equations are correct for the AUTO case, they are not necessary since 
Onj = Immei-y for j =1,2,..,m+1 (AUTO). (9a) 
and 
By = %p - (9b) 
Finally, defining 
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le 
ea PL ee (10) 


Bn, i=0 
annio= 1, 
Om+1,i = Imi + Kms Om for i= 1,2,....m, 


Om+im+t = Km» 
and 
Ome = Om — ke By » 

step mis completed. 

3.3 Termination (end of step M—1) 

At the end of step M — 1, the results 
a = ay, for k =1,2,....M 
and 
a=ay (uy) 


are obtained. In addition, the intermediate parameter set {k),k,...k,} is supplied as an output. These 
parameters are often called reflection coefficients for the AUTO case. In the AUTO case, they will all 
have a magnitude less than one, and represent reflection coefficients in an acoustic tube model of 
speech production. What meaning they may have in the COVAR case is not clear. 


3.4 Numerical Accuracy 


In essence, the solution is an indirect inversion of a matrix whose elements are the (c,} coefficients, 
whose determinant is the product 86,82 °-~-By-1. Theoretically, the coefficients {8,} are non- 
negative, and in fact are positive for the AUTO case. A negative value for one of the coefficients {B,) 
can only result from a numerical error. A zero value could result in the COVAR case. 


Any very small value of one of the coefficients {8,} will indicate problems, for they are used as divi- 
sors in Eq. (8b) for COVAR and as divisors in Eq. (10) for COVAR and AUTO, thus amplifying the 
effects of any numerical errors in evaluating the numerators of Eq. (8a) and Eq. (10). This problem is 
not relieved by resorting to other solution methods such as Gauss-Siedell, and can only be handled by 
increasing the number of significant figures, lowering the value of M, or by properly pre-emphasizing 
the data [1, Chapter 9]. 


Both subroutines have test statements to test for a zero or negative a, or B,. A print statement is 
placed at the appropriate point in the program to warn the user that a singular matrix has been defined. 
4. Program Description 
4.1 Usage 


Inputs and outputs to the subroutines COVAR and AUTO are in the argument lists, 
COVAR(N,X,M,A,ALPHA,GRC) and AUTO(N,X,M,A,ALPHA,RC). The inputs are 


N the number, N, of data points, 
X(-) the input data with X(k) = x(k—1) for k = 1,2,...,N, 
M the order, M, of the filter. 
The main outputs are the coefficients {a,} contained in the dimensioned array with 


A(l) =1 
A(k) =q_, for k =2,3,.,.M+1. 


An auxiliary set of outputs are the coefficients {k,,} with 


GRC(m) = kp 
RC(m) =k,, for 


(COVAR) 
(AUTO) 
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The dimensioned variables X(-), A(-), and GRC(-) or RC(-) are dimensioned by the calling pro- 
gram. The dimension of X(-) must be at least N, the dimension of A(-) must be at least M + 1, and 
the dimension of GRC(-) or RC(-) must be at least M. ALPHA defines the residual energy of Eq. 
(11). 


Table 1: Program Variables 


TEXT COVAR AUTO 
N N N 

x(n) X(n+1) X(n4+)) 
M M M 

In A(i+1) A(i+1) 
a, ALPHA ALPHA 
k, GRC(m) RC(m) 
Cua, CCU+1) R(m+2-/) 
ae BETA(m+1) ALPHA 
Ym GAM = 

Omi B() AC) 


Table 2: Minimum Dimensions for Variables 


DIMENSIONED MIN, DIM. MIN. DIM. 
VARIABLE FOR COVAR FOR AUTO 

xX) N N 

AC) M+1 M+1 

cc(-) M+1 

RC) M+1 

GRC(-) M 

RC(-) M 

BETA(:) M 

BC.) M(M-1)/2 


4.2 Program Variables 


Table 1 shows a listing of the variables in this discussion. While some of the variables in the discus- 
sion have double subscripts, only singly dimensioned variables are used in the program. 


The coefficients {5,,} do not appear explicitly in AUTO, for they are related to the coefficients (a,,,} 
by Eq. (9a). In COVAR these coefficients are stored in the singly dimensioned array B(-) in the order 


(611,621,622.631,632, b33-Bays-s-by—im—1) » 
Table 2 shows the minimum dimension needed for each of the dimensioned variables. The subroutines 


are presently set to handle values of M up to 20. For values of M larger than 20, the dimension state- 
ments in the subroutines must be changed according to Table 2. 


5. Test Program 


A sample test program and its output is given. This particular program first generates a 40 point 
data sequence which is the unit sample response of the filter 


1/[1 — 1.4427! + 1.262-7 — 0.812->3] . 


As the filter is third order and the numerator is of lower order than the denominator, the covariance 
approach with M=3 theoretically reproduces the denominator and gives a total squared error of zero. 
The test program gives the results of both covariance and autocorrelation methods for M=2 and M=3, 
and for M=3 indicates this, within the limits of computer accuracy, giving a residual energy of 0.6x10-> 
for M=3 as opposed to 1.7 for M=2. 
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The data sequence is then shifted by three steps, with three zeros appended at the start and end for 
the new 46 point sequence. Running both the methods on this sequence theoretically gives identical 
results to the autocorrelation method for the 40 point sequence with M=3. This is seen in the final 


results for the test program printout. 


1. Markel, J. D. and Gray, A. H., Jr., Linear Prediction of Speech, Springer Verlag, New York, 1976. 


References 


Table 3 


OUTPUT DATA FROM AUTO/COVAR 


1 0,100000E 

2 -0.108019E 

3 0.197712E 
0.172095E 01 

1 0.100000E 

2 -0.116199E 

3 0.283199E 
0.308386E 01 

1 0. 100000E 

2 -0.143999E 

3 0.125999E 


4 -0.809997E 
0.619888E-05 


5 0.100000E 
2 -0.13 308E 
3 0.110826E 
4 -0.710041E 
0.152910E 01 


4 0,100000E 
2 -0.136308E 
3 0.110826E 
4 -0.710042E 
0.152910E 01 

1 0.100000E 
2 -0.136308E 
3 0.110826E 
4 -0.710041E 
0.152910E 01 


01 
01 
00 


01 
o1 
00 


01 
01 
01 
00 


01 
01 
01 
00 


01 
01 
01 
00 


01 
01 
01 
00 


-0.891115E 
0.197712E 
0.000000E 


-0.905548E 
0.283199E 
0. 000000E 


-0.935486E 
0.313706E 
-0.809997E 
0.000000E 


-0.905548E 
0.283199E 
-0.710041E 
0.000000E 


-0.905548E 
0.283199E 
-0.710042E 
0.000000E 


-0.905548E 
0.283199E 
-0.710041E 
0.000000E 
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00 
00 
00 


00 
00 
00 


00 
00 
00 
00 


00 
00 
00 
00 


00 
00 
00 
00 


00 
00 
00 
00 
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Efficient Lattice Methods For Linear Prediction* 


R. Viswanathan and J. Makhoul 


Bolt Beranek and Newman, Inc. 
50 Moulton Street 
Cambridge, MA 02138 


1. Introduction and Purpose 


The lattice formulation for linear prediction was introduced in speech processing by Itakura. [1]. 
Recently, Makhoul [2] showed the existence of a class of such lattice methods all of which have the 
following properties in common: (1) windowing of the signal is not required; (2) the resulting all-pole 
linear prediction filter is guaranteed to be stable; (3) stability is less sensitive to finite wordlength com- 
putations; and (4) quantization of the lattice model parameters (for the purpose of data compression) 
can be accomplished within the recursion for retention of accuracy in representation. However, the 
computation for these lattice methods is about four times more expensive than the traditional auto- 
correlation and covariance methods. To overcome this drawback, Makhoul introduced the covariance 
lattice (CL) methods: these compute the lattice model parameters directly from the covariance of the 
signal, and thus require about the same order of computational complexity as the traditional autocorre- 
lation and covariance methods [2]. (For additional references on lattice methods, see [3]-[5].) 


Given the covariance matrix of the signal, the subroutines COVLAT and CLHARM described 
below compute the parameters of the lattice model, known as the reflection (or partial correlation) 
coefficients,t and the predictor coefficients of the all-pole filter. COVLAT is a general routine in that it 
allows, through proper specification of input parameters, the choice of any one of a large class of CL 
methods. On the other hand, CLHARM uses a specific method, namely the harmonic-mean method 
[2]; consequently, the routine CLHARM requires less computation than COVLAT as it capitalizes on 
the specific structure of the harmonic-mean method. 


We also give two other subroutines, COVARI and COVAR2, for computing the covariance of the 
signal. When using COVARI, one computes at the outset the covariance of the signal up to the max- 
imum desired lag, and employs this fixed covariance in the estimation of all the reflection coefficients. 
COVAR2, on the other hand, recomputes for each new lattice stage the covariance up to that stage in a 
manner that makes maximum use of the signal data [2]. To allow the use of CL methods with either 
type of covariance computation, the subroutine COVLAT and CLHARM have been organized for com- 
puting the reflection coefficient of only one stage at a time. 


Covariance computation with COVARI is more common among speech researchers. It can be 
shown that when the routine COVAR2 for computing the covariance is used in conjunction with the 
harmonic-mean method, the results obtained are identical to those using Burg’s technique [3] as 
described in [6], the latter technique being more popular in the geophysics area. However, the use of 
the covariance lattice routine CLHARM given below results in about a four-fold savings in computa- 
tion. 


2. Brief Review of the Methods 


For a detailed exposition of covariance lattice methods, the reader is referred to [2], The purpose of 
this review is to aid the reader in understanding the description of program parameters given in Section 
3 below, and to point out some changes in the algorithm that are necessitated by the ANSI FORTRAN 
convention of nonzero subscripts. 


This work was supported by the Information Processing Techniques Branch of the Advanced Research Projects Agency. 
t Partial correlation coefficients are actually the negative of the reflection coefficients as defined here. 


4.2-1 


LPC Programs Chapter 4 


2.1 Lattice Formulation 


Linear prediction methods model the signal spectrum by an all-pole spectrum with a transfer func- 
tion given by 


H(z) = G/A(z) (la) 
where 


A(z) =14+ ¥ az (1b) 
k=l 
is the inverse filter, G is a gain factor, a, are the predictor coefficients, and p is the number of poles or 


predictor coefficients in the model. If H(z) is stable (minimum phase), A(z) can be implemented as a 
lattice filter [1], as shown in Fig. 1. 


foin) f,(n) fin) (0) f,(n) 


Es. ees oF: 
atNaZn....42 


byin) b(n) ba (n) b(n) by in) 


a(n) 


Fig. 1 Lattice inverse filter 4 (z) 


The quantities /,,(n) and 6,,(n) denote the forward and backward errors or residuals at the output of 
the m'" lattice Stage at time ». From Fig. 1, we have: 


So(n) = bo(n) = s(n) (2a) 
Sm) = fn 0) + Knit Om (n= VD (2b) 
bm sin) = Kinstfn(n) + by, (n=D (2c) 


where s(n) is the input signal, K,,,, is the reflection coefficient at stage m + 1, and e(n) = Sy(n) is 
the output residual. 


The reflection coefficients K,, in the lattice are uniquely related to the predictor coefficients. We 
give below the recursive relations for obtaining a, from K,,. These relations are employed by both 
subroutines COVLAT and CLHARM: 

alm =K 

ai” = ain) + Kap”, 1< 7 <m-1, (3) 
where ay, 1 <j < m, are the predictor coefficients at stage m. The equations in (3) are computed 
recursively for m = 1,2,...,~ the final solution is given by a, = a”, 1 <j <p. The necessary and 
sufficient condition for the stability of H(z) is given by 


IK,l <1, 1&em<p. (4) 
2.2 Covariance Lattice Recursions 


For easy reference, major relations used by the two subroutines COVLAT and CLHARM are given 
below, employing only nonzero subscripts. (For example, the covariance matrix element #(0,0) in [2] 
is denoted here by (1, 1).) 


Assume that the input signal s(n) of the lattice in Fig. 1 is given in the range 1 <n <N. We 
then define the following four quantities: 
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F, = ¥ SR(n) (Sa) 
n=L 
N 

B, = X baln) (Sb) 
nak 
N 

B,, = & 62(n-1) (Sc) 
n=l 
N 

Cn = ¥ f(t) by (nV). (5d) 
n=L 


The lower limit L = p +1 if COVARI is used for the covariance computation, and L = m +1 if 
COVAR2 is employed instead. The time averages in Eq. (5) approximate expected values considered 
in reference [2], where the above quantities F,,, B,,, B,,, and C,, are denoted, respectively, by F,,(n), 
By, (n), B,y(n-1) and C,,(n). Below, we shall call F,, and B,, as the mean-square value (or the vari- 
ance) of the forward and backward residuals, respectively. 


From Eqs. (2) and (5), one can show that the residual variances at stage m+1 are given in terms of 
Fiyy Biny Cm and Km 41, a8 follows: 
Fast = Fy + 2KinsiGn + Kae Bn (6a) 
Bru = KiaFe + 2Kinsi Gn + B (6b) 
We employ the symbols K/,, and K,, to denote the reflection coefficient at stage m + 1 produced 
by minimizing, respectively, the forward residual variance F,,,, (forward method), or the backward 
aap variance B,,,, (backward method). X,,,, or K/,,; shall denote the 7 mean between Kj, and 
K?,, (see below), K/ and K* have the same sign [2], which shall be denoted by S: 
S = sign K/= sign K°. 
2.2.1 General Covariance Lattice Method (COVLAT) 


Three quantities, F,,, B,, and C,,, are needed for computing the reflection coefficient at stage 
m +1, The three quantities are computed in the subroutine from the following equations: 


F,, = (1,1) +2 > afb, it) + 3 fa" Pb (i+1,i+1) 


i=l ind 


+2 ‘ 3 aa! b(i+1,j+1) (7) 


i=l j=i+l 


B,, = 6(m+2,m+2) +2 $ a"'(m+2,m+2-i) 
i=l 
+ z la” ]?¢ (m+2—i, m+2-i) 
i=l 


mlm 
+25 Y aa!” d(m+2-i,m42-)) (8) 


j=l jait 


Cor = 6(1,m42) + ¥ a (6C,m42—1) + 6(41,m42)] 


+ ¥ lo 26 (4+1,m4+2—1) 


+ + sP a” a! [b(i4+1,m42—/) + 6(/+1,m42-1)] (9) 
j=l jmi+l 
We then have 
Kha = — Cy/ By (10) 
Key =— G Pi |e (11) 
Ket = sit (Kpal’ + [Kpa lO, (12) 
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where r is the order of the generalized mean. The three specific choices r=0, —1, and —co 
correspond to the three methods: geometric-mean method corresponding to that of Itakura [1], 
harmonic-mean method corresponding to that of Burg [3], and the minimum method [2]. The 
reflection coefficient estimates for the three methods are given below: 
Kt = — Cyl) Fn Bm = SI Kis K sn (13) 
Knit = — 2C,,/(F, +B) (4) 
ani = 5 min (KL, |, [Koa 1) (15) 
Stability of the all-pole filter H(z) can be guaranteed if r < 0 [2]. Given F,,, B,,, C,, and the com- 
puted value for K,,,,, COVLAT computes the residual variance F,,,,; and B,,,, using the recursive 
relations (6). 


2.2.2 Harmonic-Mean Method (CLHARM) 
For this method, substantial savings can be achieved by computing the sum of the forward and 
.backward residual variances directly as follows: 
F,, + B, = (1, 1) + 6(m+2,m+42) 
+2 ¥ a6, i41) + 6(m42,m42-i)] 


i=l 
+ Ds La” PIbG+1,i+1) + 6(m4+2-i,m4+2-1)] 
+ 2 = a{™a\™[alit1,/+1) + 6(m42—im42—))] (16) 
i=l jnit 
nay expression for C,, stays the same as given above in Eq. (9). Then, K,,}, is computed using Eq. 
For the special case of the harmonic-mean method, the value of K,,!; given in Eq. (14) minimizes 
eae of the forward and backward variances F,,,; + B,,,;. One can show from Eqs. (6) and (14) 


Fat + Busy = [UL — (Ky hy )7) Fy +8,,)- (17) 
Subroutine CLHARM uses Eg. (17) instead of Eq. (6). 
2.3 Covariance Computation (COVARI and COVAR2) 


Given the signal s(n), 1 < n < N, its covariance is computed using one of the two methods given 
below. 


2.3.1 Method I (COVARL) 


N 
bi = YL slkt+l—-is(k+l-/), 1<i jf < pt, (18) 
k=p+l 


where p is the order of the predictor or the number of lattice stages. Only the first row of p +1 ele- 
ments (i=1, 1<j<p+l) of the covariance matrix is computed using the above expression. All other p 
rows are computed using the symmetry property of the covariance matrix (i,j) = (j,i) and the fol- 
lowing recursive relations: 
(4j) = d(i-1,j—1) + s(pt+2—-i) s(pt2—/) 
— s(N4+2—-i)s(N42-j), 2<i j < pti. (19) 


The elements (i,j) are computed only once and remain fixed throughout the solution. 
2.3.2 Method 2 (COVAR2) 

Here, all covariance terms up to stage m are recomputed for each new stage. The covariance for 
stage m is defined as follows: 


N 
on (ij) = YS slk+l—i)s(kt+1-/), 1 < ij < mt (20) 


k=mtl 
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The first m rows of the covariance matrix are computed from the covariance for stage m — 1, using the 
symmetry property and the following recursive relations: 
Hm (ii) = bm—aCij) — s(m41—A s(m41-/), 1 <i i <m (21) 
The elements of the (m+1)"" row are computed as follows: 
N 
,(mt1,1) = Y s(k)s(k—m) (22a) 
k=m+1 

by, (m4+1,j) = bm—1(mj—l) — s(N+1—m)s(N4+2-j), 2 <j < mt. (22b) 

2.4 Number of Computations 


For computing the (p+1)x(p+1) covariance matrix for an N-sample signal, the number of multi- 
plies and adds required by the programs COVARI and COVAR2 are given in Table 1. 


Number of Multiplies 
Method and Adds 
COVARI N(p+1) 


2 


3 
COVAR2 | N(p+l) + = + ae + a -1 


Table 1. Number of multiplies and adds required for the covariance computation. 


The total number of computations required for computing p reflection coefficients using COVLAT and 
CLHARM are given in Table 2. 


Method Multiplies 


COVLAT 


7 
|cuHaRa | E+ 3 ee 


Table 2. Number of computations for getting p reflection coefficients. 


Number of shift operations given in Table 2 refers to multiplication by 2. Computations given there 
include the evaluation of forward and backward errors (see Eq. (6)) for COVLAT (4p multiplies, p 
shifts and 4p adds) and the evaluation of forward-plus-backward error (see Eq. (17)) for CLHARM (2p 
multiplies and p adds). In counting the adds, we did not consider the adds that figure in the subscripts. 
In addition to the computations given in Table 2, use of COVLAT requires p evaluations of the func- 
tion GMEAN (Section 3.2), which is the generalized mean between the reflection coefficient values 
given by the forward method and the backward method (see Eq. (12)). 


The total number of computations required for computing the reflection coefficients from the signal 
data is then found by adding the number of computations for obtaining the signal covariance (Table 1) 
to that for computing the reflection coefficients (Table 2). 
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3. Program Description 
3.1 Main Program 


The main program listed in the Appendix is provided primarily to show how the subroutines are 
called and to produce results for two test cases. For any practical problem, the user should write his 
own main program. 


For each test example, the main program computes and prints three sets of reflection coefficients 
obtained from: (1) the harmonic-mean method using CLHARM, (2) the geometric-mean method using 
COVLAT with r = 0 and (3) the minimum method using COVLAT with r = —°. For case (1), the 
main program normalizes the forward-plus-backward error at the output of the last (py stage, F, + B,, 
by dividing by 2(1,1) and prints this normalized error. The three CL methods are demonstrated 
using first Method 1 (COVAR1) for the covariance computation and then Method 2 (COVAR2). 


3.2 Subroutines 


(a) COVLAT(PHI,NMAX,M,R,IFLAG,A,K(M),FERROR,BERROR,SCR) 
Called from the main program; the parameters R and IFLAG define a class of CL methods. 

(b) GMEAN(KF,KB,R,IFLAG) 
Called by COVLAT; computes the generalized mean between the estimate KF of the reflection 
coefficient produced by the forward method and the estimate KB by the backward method. 

(c) CLHARM(PHI,NMAX,M,A,K(M),ERROR,SCR) 
Called from the main program; uses the harmonic-mean method. 

(d) COVARI(SIG,NSIG,NSTAGE,PHI,NMAX) 
Called from the main program. Since the covariance computed by this method does not depend 
on the stage number, COVAR1 is called only once before computing the reflection coefficients in 
a stage-by-stage fashion. 

(e) COVAR2(SIG,NSIG,M,PHI,NMAX) 
Called from the main program. Since the covariance computed by this method depends on the 
lattice stage number, COVAR2 is called for each new stage before the reflection coefficient is 
computed. 


3.3 Description of Parameters 
PHI Covariance matrix 


NMAX Maximum dimension of PHI, or one plus the maximum number of lattice stages. (Actu- 
ally, PHI needs to have the dimension NSTAGE+1 only. However, the user may be 
interested in experimenting with different values for NSTAGE: for example, to drive the 
prediction error(s) sufficiently low, or for any other reason. NMAX in this case is then 
one plus the maximum value of NSTAGE that the user may want to consider. Notice 
that the. maximum dimension of each of the vectors A, K and SCR defined below may be 
set to NMAX~—1; however, we have set those dimensions to NMAX for convenience.) 


M Lattice stage number 


NSTAGE Number of lattice stages or reflection coefficients, or the order of the all-pole model 
(NSTAGE is the same as p used in Section 2.) 


R Order of the generalized mean; filter stability is guaranteed for R < 0. 


IFLAG =-—1 means R = — (Minimum method) 
= 1 means R = +co (Maximum method) 
= 0 means R is finite 


A A(1) through A(NSTAGE) are the predictor coefficients of the all-pole filter 
K Reflection coefficient vector (declared to be real) 
FERROR Forward error F,, at m=NSTAGE 
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BERROR Backward error B,, at m=NSTAGE 


SCR Scratch vector 

KF Reflection coefficient given by the forward method (declared to be real) 

KB Reflection coefficient given by the backward method (declared to be real) 

ERROR Forward-plus-backward error, (F,,,+B,,) at m=NSTAGE 

SIG SIG(1) through SIG(NSIG) are the signal samples 

NSIG Number of signal samples. (NSIG is the same as N used in Section 2.) 

NO Printer, pai number (This is defined in the main program through the integer FUNCTION 


3.4 DIMENSION Requirements 


The DIMENSION statement in the main program should be modified according to the requirements 
of each particular problem. The parameters included in the following DIMENSION statement conform 
to the above parameter definitions: 


DIMENSION PHI(NMAX,NMAX),A(NMAX),SCR(NMAX),SIG(NSIG) 
REAL K(NMAX) 


3.5 Output 


The main program prints out NSTAGE reflection coefficients and the errors FERROR, BERROR 
and ERROR, all defined above. 


3.6 Summary of User Requirements 
(a) Determine the value of NMAX and adjust DIMENSION statement. 


(b) (Optional) Specify a subroutine for quantizing each reflection coefficient as it is computed. (Com- 
ments are provided in COVLAT and CLHARM as to where to insert a call to the user’s own 
quantization routine. For details on quantization, refer to [7] and [8]. No modification of the 
subroutines COVLAT and CLHARM is necessary if the user’s application does not require quant- 
ization or if the user does not want to perform quantization within the recursion.) 


4. Test Problems 


The main program has two 4" order (i.e., NSTAGE=4) test problems: (1) Non-Toeplitz covariance 
matrix case; and (2) Stationary case where the covariance matrix reduces to a Toeplitz autocorrelation 
matrix. For the first problem, the main program defines a 32-sample signal vector SIG in data state- 
ments. This signal segment was taken from 10 kHz sampled real speech data for which the traditional 
covariance method produced an unstable filter. (The "reflection coefficient" values obtained using the 
covariance method were: —1.023, —0.168, —1.684, 1.03.) 


As seen from the listing of the main program output (Table 3), the CL methods produce stable 
filters. For the second problem, which requires a stationary (or windowed) signal, the main program 
appends NSTAGE zero samples on both sides of the above-mentioned 32-sample signal vector. This 
guarantees that the resulting covariance matrix is Toeplitz. For the stationary case, all CL methods 
should give the same values for the reflection coefficients. Also, the forward error FERROR and the 
backward error BERROR should be equal. These results are readily verified from the output listing 
given in Table 3. 
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Table 3 


***FIRST TEST EXAMPLE. NON-TOEPLITZ COVARIANCE MATRIX CASE*+** 


SOLUTION USING COVARIANCE MATRIX COMPUTED VIA METHOD 1 


REFLECTION COEFFICIENTS FROM PROGRAM CLHARM 
-0.98576966E+00 0.75438073E+00 -0.16509753E+00 0.77495836E+00 


FORWARD-PLUS-BACKWARD ERROR = 0.39345233E-02 


REFLECTION COEFFICIENTS FROM PROGRAM COVLAT (R=0, GEOMETRIC MEAN) 
-0.98578447E+00 0.75686465E+00 -0.16748354E+00 0.79276231E+00 


FORWARD ERROR = 0.46530087E-02, BACKWARD ERROR = 0.31714242E-02 


REFLECTION COEFFS. FROM PROGRAM COVLAT (R=-INFINITY, MINIMUM METHOD) 
-0.98039611E+00 0.69331092E+00 -0.12956089E+00 0.60512754E+00 
FORWARD ERROR = 0.63612880E-02, BACKWARD ERROR = 0.37597384E-02 


SOLUTION USING COVARIANCE MATRIX COMPUTED VIA METHOD 2 


REFLECTION COEFFICIENTS FROM PROGRAM CLHARM 
-0.98586581E+00 0.48746297E+00 0.27865216E+00 0.26831956E+00 


FORWARD-PLUS-BACKWARD ERROR = 0.39385329E-01 


REFLECTION COEFFICIENTS FROM PROGRAM COVLAT (R=0, GEOMETRIC MEAN) 
-0.98589755E+00 0.50014503E+00 0.31662578E+00 0.35155942E+00 


FORWARD ERROR = 0.61631529E-01, BACKWARD ERROR = 0.17051948E-01 


REFLECTION COEFFS. FROM PROGRAM COVLAT (R=-INFINITY, MINIMUM METHOD) 
~0.97801873E+00 0.39491358E+00 0.18140856E+00 0.14482672E+00 


FORWARD ERROR = 0.65123382E-01, BACKWARD ERROR = 0.14874170E-01 
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Table 3 
(Continued) 


***#SECOND TEST EXAMPLE. STATIONARY OR TOEPLITZ MATRIX CASE*++ 
SOLUTION USING COVARIANCE MATRIX COMPUTED VIA METHOD 1 


REFLECTION COEFFICIENTS FROM PROGRAM CLHARM 
-0,97392271E+00 0.22170082E+00 0.20598015E+00 0.14759705E+00 


FORWARD-PLUS-BACKWARD ERROR = 0.45846863E-01 


REFLECTION COEFFICIENTS FROM PROGRAM COVLAT (R=0, GEOMETRIC MEAN) 
-0.97392271E+00 0.22170082E+00 0.20598015E+00 0.14759705E+00 


FORWARD ERROR = 0.45846863E-01, BACKWARD ERROR = 0.45846863E-01 


REFLECTION COEFFS. FROM PROGRAM COVLAT (R=-INFINITY, MINIMUM METHOD) 
-0.97392271E+00 0.22170082E+00 0.20598015E+00 0.14759705E+00 


FORWARD ERROR = 0.45846863E-01, BACKWARD ERROR = 0.45846863E-01 


SOLUTION USING COVARIANCE MATRIX COMPUTED VIA METHOD 2 


REFLECTION COEFFICIENTS FROM PROGRAM CLHARM 
-0.97392271E+00 0.22170082E+00 0.20598015E+00 0.14759705E+00 


FORWARD-PLUS-BACKWARD ERROR = 0.45846863E-01 


REFLECTION COEFFICIENTS FROM PROGRAM COVLAT (R=0, GEOMETRIC MEAN) 
-0.97392271E+00 0.22170082E+00 0.20598015E+00 0.14759705E+00 


FORWARD ERROR = 0.45846863E-01, BACKWARD ERROR = 0.45846863E-01 


REFLECTION COEFFS. FROM PROGRAM COVLAT (R=-INFINITY, MINIMUM METHOD) 
-0.97392271E+00 0.22170082E+00 0.20598015E+00 0.14759705E+00 


FORWARD ERROR = 0.45846863E-01, BACKWARD ERROR = 0.45846863E-01 
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Linear Predictor Coefficient Transformations 
Subroutine LPTRN 


A. H. Gray 


Department of Electrical Eng. & Computer Science 
University of California at Santa Barbara 
Santa Barbara, CA 93106 


and 


J. D. Markel 


Signal Technology, Inc. 
15 De La Guerra Street 
Santa Barbara, CA 93101 


1. Purpose 


The purpose of the subroutine LPTRN is to allow the user to transform between the different 
parameter sets often used in linear predictive speech analysis to describe the synthesis filter 


H(z) = Va/A(z), a) 
where 
M 
A(z) = ¥ az with ag=1. (2) 
k=0 


The program is a slight modification of the program LPTRAN in [1], where a more detailed discussion 
may be found. 


2. Parameter Set Choices 


Table 1 shows the choices of parameter sets to be used as inputs, along with their FORTRAN labels. 
The column labeled I, where I = 1, 2,...,6, defines which parameter set is to be used as an input to the 
subroutine. All other parameter sets are then outputs. 


I Name Text FORTRAN Subscript Range 
1 filter coefficients ag=1 A(l) =1 
a, AG+1) =SAV) f= 1,2,...M 

gain a ALPHA 

2 cepstral coefficients cj) Cc(U+1) j=0,1,....M 

3 autocorrelation coefficients r(j) R(j+1) j=0,1,....M 

4 reflection coefficients k, RC) j= 1,2,....M 
input energy r(0) R(1) 

5 log area ratios In(S/S),) ALAR() j=1,2,...M 
input energy r(0) R() 

6 area functions S, AREA(j+1) j=0,1,...,.M 
input energy r(0) R(1) 


Table 1. Definitions of Text and Fortran Variables for subroutine LPTRN 


In each case, there are a total of M + 1 parameters which uniquely describe the filter H(z), When 
the array A(-) for the filter coefficients is used as an input (I=1), then the value of A(1) is ignored, 
since a)= 1 by definition. When A(-) is an output (I1), then A(1) is set equal to one by the pro- 
gram. When the array representing the are functions, AREA(-), is used as an input (I=6), then M + 2 
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Parameters are actually entered into the subroutine. When AREA(:) is an output (16), then 
AREA(M +1) is always set equal to one for normalization. 

2.1 Filter Coefficients 


This is the parameter set {ao,a,...,@,) defining the filter denominator as in Eq. (2), The coefficient 
4, equals one by definition. On input A(1) is ignored (I=1). When A(-) is an output (I¥1), then 
A(1) = 1. During the calculations another dimensioned array, SA() is used, where 


SAGY)=a, for j=1,2,....M. 
This is to avoid changing any values of A(-) when it is used as an input (I=1). 
2.2 Cepstral Coefficients 


When H(z) is stable and causal, or A(z) is minimum phase, a set of cepstral coefficients {c(k)} is 
defined by 


InlVa/A (z)] = > c(k)z-*, (3) 
k= 
or equivalently, 
(0) = InfVa] (4a) 
c(l) +a,;=0 (4b) 
nc(n)+na,=— = (n—k)e(n—k)a, , (4c) 
kl 
for n = 2,....M. 


Equation (4c) can also be used for n > M, provided one defines 
a4=0 for k>M. (5) 


Equations (4) can be used directly to find the cepstral coefficients from the filter coefficients or vice 
versa. If the filter H(z) is not stable, the results are meaningless. 


2.3 Autocorrelation Coefficients 
When the filter H(z) is stable, the autocorrelation coefficients {r(k)} are defined by 


H@)H(/z) = ES rlkz-*, ) 
kao 
and are even functions of k, 
r(k) =r(-k). (7?) 


The autocorrelation coefficients {r(0),r(1),....7 (M)} can be used as inputs or outputs in the subrou- 
tine. When used as inputs, the standard Levinson recursion is used to define a "step-up" procedure. 
This is abbreviated as follows. First there is an initialization of the form 


ao=r(), k,=—r(1)/r(), (9a) 
a=, ayn=k, (9b) 
a, = ag(1—k?). (9c) 


This is followed by the recursive steps 
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m=l 
1 lee Hm fans P (10a) 
j= 
Qno= 1 (10b) 
Qnj = Am—1,j + Km4m-1m-; for j = 1,2,....m—1 (10c) 
nm = Km» (10d) 
Om = &m—1—k 2) , (10e) 
for m = 2,3,...,M. At the completion of the recursion, 
a= ay, for k=0,1,...,M, (11a) 
and 
a=ay- (11b) 
A necessary and sufficient condition for stability of H(z) is that 
Ikjl|<1 for j=1,2,....M. (12) 


Therefore a division by zero cannot theoretically occur in Eq. (10a) for a stable filter. 


If the autocorrelation sequence is not an input (I#3), then it is found from the same step-up 
approach, but with the input being the reflection coefficient set {k,k,....k,y} and the energy term r(0). 
The only changes in the formulas lie in replacing Eq. (9a) by 


ag=r(O), r(1) =— kyr (0) (13) 
removing Eq. (10a), and inserting at the end of step m the expression 
r(m) =—- y r(m—j)an, « (14) 


j=\ 
2.4 Reflection Coefficients 


The reflection coefficients {k\,k»,...,,¢} represent the reflection coefficients for an equivalent acous- 
tic tube model for H(z). When used as inputs along with the filter energy r(0), the filter coefficients 
and autocorrelation coefficients are generated as described above. 


When the filter coefficients are used as an input (I=1), the reflection coefficients are generated 
through a "step-down" procedure as follows. First, the initialization of Eq. (lla) is performed. Then 
taking m = M,M-1....,1, 


Km = @mm » (15a) 
am—1o=1, (15b) 
and 
a 
Amy = a 1 a - (15c) 


for j = 1,2,...,m—1. 
2.5 Log Area Ratios 
The log area ratios are a nonlinear transformation of the reflection coefficients, given by 
In(S,/S)_)) = In((1—k))/(1+k)] for j = 1,2,....M. (16) 


Scaling of all area functions by the same scale factor does not change the filter, for only the ratio of 
area functions enters into the calculations. When area functions are calculated as an output of the sub- 
routine (I#6) the value of Sy is always normalized to one. 


2.6 Area Functions: 


The area functions {So,S), . . . , Sy) are areas of an acoustic tube model of H(z). They are related 
to the reflection coefficients by the equation . 
S/S, = (—k,)/(1+k)) for j = 1,2,...,M. (17) 
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Scaling of all area functions by the same scale factor does not change the filter, for only the ratio of 
area functions enters into the calculations. When area functions are calculated as an output of the sub- 
routine (I#6) the value of Sy is always normalized to one. 


3. Filter Stability 


The various transformations are meaningless if the filter H(z) is not a stable causal filter. Causality 
of the filter H(z) will be assumed, so that stability of H(z) is equivalent to H(z) being minimum 
phase. Stability can be guaranteed in advance for the cases I= 4, 5, and 6. When the reflection 
coefficients are input (I=4), their magnitudes must be less than one. When the log area functions are 
input (I=5) stability is guaranteed. When the area functions are input (I=6), they must all be positive 
to guarantee stability. 


When the parameters represent a stable H(z) there will be no error messages from the subroutine. 
Should parameters for an unstable H(z) be used then there will be attempts to take the logarithm of a 
nonpositive number in the evaluation of the log area functions, and there may be a division by zero. 


A short stability test, DO loop 330, is inserted in the subroutine to test the magnitudes of the 
reflection coefficients. If they do not satisfy Eq. (12) an error message is printed out. This subroutine 
provides a stability test for any rational digital filter whose denominator is expressed in the form of Eq. 
(2), and is equivalent to the Schur-Cohn method [2,3]. 


4. A Test Example 


The program can be used to test itself by changing the index I after each use. An example test pro- 
gram is given in the Appendix. Here the program generates the first parameter set to be used as an 
input (I=1) using M = 3, ag= 1, a; = —.45, a= .81, a;= 0, and a = 10. By incrementing I from 1 
through 6, the roles of inputs are changed according to Table 1. Each printout will be the same, except 
for possible computer roundoff errors and the index I. A sample printout is shown in Table 2 for I = 1. 


The example used here illustrates how one can get additional information about autocorrelation 
values and cepstral coefficients. Note that the filter is actually only of second order. If M = 2 had 
been used, then the autocorrelation values and cepstral coefficients would only have been evaluated up 
to a subscript of 2. By setting M = 3 and a, = 0 they are evaluated up to a subscript of 3. 
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Table 1 


OUTPUT DATA FROM LPTRN TEST PROGRAM 


1 10.000001 


1.000000 
-0.450000 
0.810000 
0.000000 


2.302585 
0.450000 
0.708750 
-0.334124 


2 9.999994 


1.000000 2.302585 
-0.450000 0.450000 
0.809999 -0.708750 
-0.000000 -0.334124 
3 09,.999999 
1.000000 2.302584 
-0.449999 0.449999 
0.809999 -0.708749 
-0.000000 -0.334124 


4 09.999999 


1.000000 
-0.449999 
0.809999 
-0.000000 


2.302584 
0.449999 
-0.708749 
-0.334124 


5 10.000011 


1.000000 
-0.449999 
0.809999 
-0.000000 


2.302586 
0.449999 
-0.708749 
-0.334124 


6 10.000011 


1.000000 
-0.449999 
0.809999 
-0.000000 


2.302586 
0.449999 
-0.708749 
0.334124 


30.993995 
7.705689 
-21.637573 
-15.978511 


30.993957 
7.705680 
-21.637542 
-15.978488 


30.993957 
7.705680 
-21.637542 
-15.978488 


30.993957 
7.705679 
-21.637542 
-15.978483 


30.993957 
7.705673 
-21.637538 
-15.978466 


30.993957 
7.705673 
-21.637538 
-15.978466 


4.3-5 


-0.248618 
0.810000 
0.000000 
0.000000 


-0.248618 
0.809999 
-0.000000 
0.000000 


-0.248618 
0.809999 
-0.000000 
0.000000 


-0.248618 
0.809999 
-0.000000 
0.000000 


-0.248618 
0.809999 
-0.000000 
0.000000 


-0.248618 
0.809999 
-0.000000 
0.000000 


0.507879 
-2.254057 
0.000000 
0.000000 


0.507879 
-2.254056 
0.000000 
0.000000 


0.507879 
-2.254055 
0.000000 
0.000000 


0.507879 
2.254055 
0.000000 
0.000000 


0.507879 
-2.254055 
0.000000 
0.000000 


0.507879 
-2.254055 
0.000000 
0.000000 


5.732649 
9.526313 
1.000000 
1.000000 


5.732645 
9.526308 
1.000000 
1.000000 


5.732640 
9.526298 
0.999999 
1.000000 


5.732640 
9.526298 
0.999999 
1.000000 


5.732637 
9.526290 
0.999999 
1.000000 


5.732637 
9.526290 
0.999999 
1.000000 
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CHAPTER 5 


FIR Filter Design and Synthesis 


J. H. McClellan 


Introduction 


The problem of designing finite impulse response (FIR) digital filters experienced great activity in 
the early 1970’s. Most of this work was directed at the problem of optimal (in the weighted Chebyshev 
sense) filter design. The first program in this section, by McClellan, Parks, and Rabiner, will design the 
optimal Chebyshev approximation for linear phase filters. The Chebyshev optimization is done very 
efficiently by means of the Remez exchange algorithm, and this particular FIR filter design program has 
found wide use. Interestingly enough, this usage seems to have come as such from the designers of 
CCD (charge-coupled device) and SAW (surface acoustic wave) filters as from the digital filtering com- 
munity. Of course, any FIR design program can be used for these other problems since the underlying 
mathematics is the same. 


The second program in this section implements the classical method of windowed linear-phase filter 
design. Seven window types can be specified including Chebyshev and Kaiser windows. The third pro- 
gram designs maximally flat linear-phase lowpass filters. In both of these programs (5.2 and 5.3) the 
design can be expressed in closed form; no optimization is required. 


The final program, by Heute, is a subroutine for the synthesis of a finite wordlength (fixed-point 
rounding of coefficients) realization of a linear phase FIR filter. The program determines the minimum 
possible wordlength to meet the prescribed filter specifications. This technique requires, as a starting 
point, an exact (infinite-precision) design as would be obtained from a program such as the Remez 
exchange algorithm. Program 5.4 then seeks to fulfill the given specs. As a final comment, we note 
that the problem of optimizing the finite wordlength design of FIR digital filters remains an unsolved 
problem. 


The four programs contained in this section are but some of the programs (and techniques) that 
have been proposed for the design and implementation of linear-phase FIR digital filters. Other 
methods for Chebyshev approximation of linear-phase filters include Linear Programming [1,7]. 
Herrmann and Hofstetter’s method [2,5], and McCallig’s CONRIP program [6]. Among other error 
norms, the weighted least-squares norm is a straightforward method that is not restricted to linear- 
phase filters. 


One important difference among various methods is the manner in which the desired filter is 
specified. The filter design process is always a compromise among filter length, transition width, and 
passband and stopband deviation (in the bandpass case). Not all of these specs can be chosen arbi- 
trarily. In connection with program 5.1 the work of Herrmann, Rabiner and Chan [4] and Rabiner [8], 
describes tradeoff relationships among the various parameters. Similar results are available for window- 
ing and the maximally flat designs. 


5.0-1 
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The design of nonlinear phase FIR digital filters has Proven to be a more difficult problem. A par- 


ticular case of interest is the design of minimum phase filters. A polynomial rooting technique pro- 
posed by Herrmann and Schuessler [3] can be used to convert a linear-phase filter to a minimum phase 
design. The more general problem of optimal magnitude and phase approximation still remains as an 
unsolved problem. 
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5.1 


FIR Linear Phase Filter Design Program 


J. H. McClellan 


Dept. EECS 
M.LT. 
Cambridge, MA 02139 


T. W. Parks 


EE Dept. 
Rice University 
Houston, TX 77001 


L. R. Rabiner 


Acoustics Research Dept. 
Bell Laboratories 
Murray Hill, NJ 07974 


1. Purpose 


This program uses the Remez exchange algorithm [1], [2] to design linear phase FIR digital filters with 
minimum weighted Chebyshev error in approximating a desired ideal frequency response. A unified 
treatment of the theory of this method of filter approximation can be found in Refs. [3]-[7]. The pro- 
gram has a special built-in section for specifying the more common ideal filter types such as multi-band, 
bandpass filters, Hilbert transform filters, and differentiators. It is also possible to approximate an arbi- 
trary ideal frequency response specified by the user, but two user-written subroutines must be provided 
to replace two of the existing subroutines [6]. 


2. Method 


The frequency response of an FIR digital filter with an N-point impulse response {h(n),n=0, 1,...,N—1]} 
is the z-transform of the sequence evaluated on the unit circle, i.e., 


N=1 
H(f)' = H()|,_ er = LD (ne. (1) 


n=O 


The frequency responses of a linear phase filter can be written as 
HN = GNexe| (AE - (Arann Q) 


where G(/) is a real valued function and L = 0 or 1. It is possible to show that there are exactly four 
cases of linear phase FIR filters to consider [3,5]. These four cases differ in the length of the impulse 
response (even or odd) and the symmetry of the impulse response [positive (L=0) or negative (L=1)]. 
By positive symmetry we mean h(n) = h(N—1—n), and by negative symmetry h(n) = —h(N—1—n). 


In all cases, the real-valued function G(/) will be used to approximate the desired ideal magnitude 
specifications since the linear phase term in Eq. (2) has no effect on the magnitude response of the 
filter. The form of G(f) depends on which of the four cases is being used. Using the appropriate 


1 For convenience, throughout this paper the notation H(f) rather than H(e’?*/) is used to denote the frequency response of 
the digital filter. 
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symmetry relations, G(/) can be expressed as follows: 


Case 1: Positive symmetry, odd length: 
Ml 


G(f) = ¥ a(n)cos(2rnf) (3) 


n=O 
where N1 = (N—1)/2, a(0) = A(N1), and a(n) = 24(N1—n) for n = 1,2,...,N1. 


Case 2: Positive symmetry, even length: 
NM 
Gf) = ¥ b(n) cosl2a(n — pa (4) 
n=l 


where N1 = N/2 and b(n) = 2h(N1—n) for n = 1,...,N1. 
Case 3: Negative symmetry, odd length: 


G()= > c(n)sin (2anf) (Ss) 


n=l 


where NI = (N—1)/2 and c(n) = 2h(N1—n) for n = 1,2,...,N1 and h(N1) = 0. 


Case 4: Negative symmetry, even length: 


N) 
GN = ¥ ainsinvdan = DA ©) 


n=l 


where N1 = N/2 and d(n) = 2h(N1—n) for n = 
All four cases can be combined into one algorithm. This is accomplished by noting that G(/) can be 
rewritten as G(f) = Q(f) P(f) where P(/) is a linear combination of cosine functions. 


It is convenient to express the summations in (4)-(6) as a sum of cosines directly. Simple manipula- 
tions of (4)-(6) yield the expressions 


Case 2: 
MI 1 Nixl _ 
LX b(n) cosl2a(n — pA =cos(rf) ¥ b(n)cos(2anf) 7) 
nat n=O 
Case 3: 
M Nil 
e(n)sinQQanf) = sinQaf) LY @(n)cos(2anf) (8) 
n=l n= 
Case 4: 
MI / 1 f Nini _ 
L d(n)sin[2a(n — pA =sin(rf) YS d(n)cos(2an/) (9) 
n=l n=O 


where 
61) = 6) + 4 5a) 


b(n) = + (n=) + BaD], 
Case 2: ie aoa fs | (10) 


6(N1) = + 6(N1-1) 
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ed) = 200) - 4 202) 


c(n) = $ [e(n—1) — e(n +01, 
Case 3: n = 2,3,....N1 —2 ay 
e(N1-1) = + 2(N1-2) 


e(M1) = 4 e(1-1) 


dQ) = d() — t a(1) 


d(n) = F1d(n-1)-a()}, 
n =2,3,....N1—1 
a(n) = + UNI). 


Case 4: (12) 


The motivation for rewriting the four cases in a common form is that a single central computation rou- 
tine (based on the Remez exchange method) can be used to calculate the best approximation in each of 
the four cases. This is accomplished by modifying both the desired magnitude function and the weight- 
ing function to formulate a new equivalent approximation problem. 

The original approximation problem can be stated as follows: given a desired magnitude response D(/) 
and a positive weight function W(/), both of which are continuous on a compact subset of l0,5) (note 


that the sampling frequency is 1.0) and given one of the four cases of linear phase filters li.e., the 
forms of G(/)], then one wishes to minimize the maximum absolute weighted error, defined as 


ED |l= max wi)|D(N-Gi)| (13) 


over the set of coefficients of G(/). 
The error function E(/) can be rewritten in the form 


EW) = WNIDIN-GUN1 = WOW a - vep| aa) 
if one is careful to omit those endpoint(s) where Q(/) =0. Letting DY) = D()/Q(/) and 
W(f) = W(/) Q(/), an equivalent approximation problem is to minimize the quantity 


JEW = max WN|DN-PY/)| (15) 


by choice of the coefficients of P(/). The set F has been replaced by F’ = F - {endpoints where 
O(f)=0}. 


The net effect of this reformulation of the problem is a unification of the four cases of linear phase FIR 
filters from the point of view of the approximation problem. Furthermore, Eq. (15) provides a 
simplified viewpoint from which it is easy to see the necessary and sufficient conditions that must be 
satisfied by the best approximation. Finally, Eq. (15) shows how to calculate this best approximation 
using an algorithm which can do only cosine approximations (Case 1). The necessary and sufficient 
conditions for this best approximation are given in the following alternation theorem [1]. 
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Alternation Theorem: If P(f) is a linear combination of r cosine functions i.e., 
rl 
P(f) = ¥ a(n)cos (2anf) , 
n=0 
then a necessary and sufficient condition that P(/) be the unique best weighted Chebyshev approxima- 
tion to a continuous function D(/) on F' is that the weighted error function E(F) = W(f) 
[D(/)—P(/)] exhibit at least r + 1 extremal frequencies in F’. 


These extremal frequencies are a set of r+1 points {A}, i=1,2,....7+1 such that 
F< Fao-+ <F < Fray with ECF) = —E(F4)), 1 = 1,2,...r and |E(F)| = max| E()|. 


An algorithm can now be designed to make the error function of the filter satisfy the set of necessary 
and sufficient conditions for optimality as stated in the alternation theorem. The next section describes 
such an algorithm along with details of its implementation. 


3. Program Description 


The program consists of a main program that handles the input, sets up the appropriate approximation 
problem, calls the Remez exchange subroutine and handles the output of the optimal filter coefficients 
and the value of the minimum error. The program contains seven subroutines the most important of 
which are REMEZ, EFF and WATE. Subroutine REMEZ implements the Remez exchange algorithm 
for Chebyshev approximation. Subroutines EFF and WATE define the desired ideal frequency 
response, D(f), and the weight function, W(/), respectively. It is possible for the user to modify 
these subroutines to suit his own choice of ideal frequency response and tolerance scheme [6]. Figure 
1 provides a summary of the overall program structure. Note that the program yields the impulse 
response of the optimum filter, but does not produce a frequency response plot. Such a plot can be 
generated easily by the user with an FFT subroutine and some straightforward graphical programs. 


PRINT OUT THE 


Fig. 1 Overall flowchart of filter design algorithm. 
The specification of the filter design problem requires the following input parameters: 


NFILT The filter length in samples. NFILT must satisfy 3 < NFILT < NFMAX (the upper 
limit can be changed by the programmer). In the present implementation NFMAX 
has been arbitrarily chosen to be 128. 


JTYPE The type of filter 
(a) Multiple passband/stopband (JTYPE=1) 


5.1-4 
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(b) Differentiator (ITYPE=2) 
(c) Hilbert transformer (JTYPE=3). 


EDGE An array of size 20. The frequency bands, specified by upper and lower cutoff fre- 
quencies, up to a maximum of 10 bands. 


FX An array of size 10. The desired frequency response in each band. 
WTX An array of size 10. A positive weight function in each band. 


LGRID The grid density, set to be 16 unless altered by the user by specifying a positive value 
for LGRID. 


The EDGE array specifies the set F to be of the form F = UB, where each frequency band B, is a 
closed subinterval of the frequency axis [0,1/2]. The arrays FX and WTX then specify the ideal 
response and weight function in each band. These input arrays are interpreted in different manners by 
the program depending on whether the filter type is a differentiator (JTYPE=2) or not. In the case of 
a differentiator FX(I) specifies the slope of D(/) in the frequency band B, while WTX(I) gives W(f) as 
1/WTX(1), resulting in a re/ative error tolerance scheme [6]. 


The set F must be replaced by a finite set of points for implementation on a computer. A dense grid of 
points is used with the spacing between points being 0.5/(LGRID-r) where r is the number of cosine 
basis functions. Both D(/) and W(/) are evaluated on the grid and stored in the arrays DES and WT 
by the subroutines EFF and WATE, respectively. Then the equivalent approximation problem is set up 
by forming D(/) and W(/) as in Eq. (14), and an initial guess of the extremal frequencies is made by 
taking r + 1 equally spaced frequency values. The subroutine REMEZ is called to perform the calcula- 
tion of the best approximation for the equivalent problem. The mechanics of the Remez algorithm will 
not be discussed here since they are treated elsewhere for the particular case of low-pass filters [4]. 


The appropriate equations ((3)-(12)) are used to recover the impulse response from the coefficients of 
the best cosine approximation obtained in the REMEZ subroutine. The outputs of the program are the 
coefficients of the best impulse response, the optimal error (min||E(/)||), and the r +1 extremal fre- 
quencies where E(/) = + ||E(/)|]. 


It is possible that one might want to design a filter to approximate a magnitude specification which is 
not included among the possibilities given above, or change the weight function to get a new tolerance 
scheme. In such cases, the user must code new functions EFF and WATE to calculate D(/) and 
W(/) as a function of £ Note that the value of fis passed to each of these functions via the parame- 
ter FREQ. The input is the same as before, except that there are only two types of filters, depending 
on whether the impulse symmetry is positive or negative (JTYPE=1 or 2). One example of the design 
of a nonstandard filter using this program is given in Ref. [6]. 


4. Design Examples 


This design example illustrates the multiband capability of the program, for an N = 5S five-band filter 
with three stopbands and two passbands. The weighting in each of the stopbands is different, making 
the peak approximation error differ in each of these bands. The required input for this example is 
given in Table 1. Table 2 shows the computer output listing, and Figure 2 shows a plot of the filter fre- 
quency response on a log magnitude scale. 


An extensive set of design examples which illustrate the versatility of this program is given in Ref. [6]. 
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MULTIBAND FILTER 
N=55 


LOG MAGNITUDE IN dB 


-90! 
0° Os 02 03 04 05 
FREQUENCY 


Fig. 2 Log magnitude response for an N = $5 multiband filter. 
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Table 1 

551 5 0 
0. -05 1 15 
0.18 +25 3 36 
0.41 5 
0. 1 0. 1 
0. 
10. 5 3 1 
20. 

0 
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Table 2 Output listing for an N = 55 multiband filter. 


DEVIATION = 0.000734754 
DEVIATION = 0.006315947 
DEVIATION = 0.021567374 
DEVIATION = 0,.026203127 
DEVIATION = -0.032680369 
DEVIATION = -0.034435446 
DEVIATION = -0.034448378 
DEVIATION = -0.034448593 


A RENREREERE ARE RES ERE EREEEREREEEEEREEEEREREREEEEEEEREEEEEEEEEEEEE HEE EE 


FINITE IMPULSE RESPONSE (FIR) 
LINEAR PHASE DIGITAL FILTER DESIGN 
REMEZ EXCHANGE ALGORITHM 


BANDPASS FILTER 
FILTER LENGTH = 5 


5 


*#es** IMPULSE RESPONSE *+++* 


H( 1) 
H( 2) 


LOWER BAND EDGE 
UPPER BAND EDGE 
DESIRED VALUE 
WEIGHTING 
DEVIATION 
DEVIATION IN DB 


LOWER BAND EDGE 
UPPER BAND EDGE 
DESIRED VALUE 
WEIGHTING 
DEVIATION 
DEVIATION IN DB 


0.10662652E-02 = 
0.63777615E-02 = 
0.35755609E-02 = 
-0.90677854E-02 
-0.90906978E-02 
0.29155630E-02 
0 .39637965E-02 
0.11172051E-01 
0.11646759E-01 
-0.99630785E-02 
-0 .92384245E-02 
-0.20406392E-01 
-0.19460483E-01 
0.31243014E-01 
0 .63045568E-02 
-0.20482803E-01 
0 .65740513E-02 
-0.11202127E-02 
0.41956986E-01 
0.35784266E-01 
0 .34744803E-01 
0.71496359E-01 
-0.17138831E 00 
-0.18255044E 00 
0.74059024E-01 
-0.10317421E 00 
0.25716721E-01 
0.37813546E 00 


BAND 1 
0. 0. 
0.0500000 0. 
0. 1. 
10.0000000 1. 
0.0034449 0. 
-49. 2565703 0. 
BAND 5 
0.4100000 
0.5000000 
o. 
20.0000000 
0.0017224 
-55.2771702 


H( 55) 
H( 54) 
H( 53) 
H( 52) 
H( 51) 
H( 50) 
H( 49) 
H( 48) 
H( 47) 
H( 46) 
H( 45) 
H( 44) 
H( 43) 
H( 42) 
H( 41) 
H( 40) 
H( 39) 
H( 38) 
H( 37) 
H( 36) 
H( 35) 
H( 34) 
H( 33) 
H( 32) 
H( 31) 
H( 30) 
H( 29) 
H( 28) 


BAND 2 
1000000 
1500000 
0000000 
0000000 
0344486 
2941783 =3 


EXTREMAL FREQUENCIES--MAXIMA OF THE ERROR CURVE 
. 0.0167411 0. 0323661 
0.1000000 0.1089286 0.1267857 
0.1800000 0.1855804 0.1978571 
0.2436160 0.2500000 0.3000000 

0. 3502232 0. 3600000 0.4100000 
0.4457143 0.4635714 0.4814285 


peeeeteeeeteteccrrrrrss 
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0. 0446429 
0.1424107 
0.2134821 
0.3122768 
0.4155804 
0.5000000 


BAND 3 
0.1800000 
0.2500000 
oO. 
3,0000000 
0.0114829 
8. 7989955 


0.0500000 
0.1500000 
0.2302232 
0.3323661 
0.4289732 


BAND 4 
0.3000000 
0.3600000 
1.0000000 
1.0000000 
0.0344486 
0.2941783 
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FIR Windowed Filter Design Program - WINDOW 


L. R. Rabiner and C. A: McGonegal 
Acoustics Research Dept. 
Bell Laboratories 
Murray Hill, NJ 07974 
D. Paul 
MIT Lincoln Laboratory 
Lexington, MA 02173 
1. Purpose 


This program can be used to design FIR digital filters using the window method [1-3]. The program 
is capable of designing lowpass, bandpass, bandstop, and highpass filters for both even and odd values 
of N, (the impulse response duration in samples), using either a rectangular, a triangular, a Hamming, 
a Hanning, a Chebyshev, or a Kaiser window. 

2. Method 


This program uses the well known method of window design for FIR digital filters. If we denote the 
N-point windows as w(), for 0 < n < N — 1, and we denote the impulse response of the ideal digital 
filter (obtained as the inverse Fourier transform of the ideal frequency response of the filter) as A(n), 
—oco <n < oo, then the windowed digital filter is given as 


h(n) =w(n)h(n) OS n<N-1 
=0 otherwise qa) 


In the discussion above it is assumed that /(n) incorporates an ideal delay of (N—1)/2 samples, and 
that w(n) is symmetric around the point (V—1)/2. 


In order to design windowed digital filters requires specification of 
1. Type of ideal filter - i.e., lowpass, highpass, bandpass or bandstop filter. 
2. Filter cutoff frequencies. 
3. Type of window - i.e., rectangular, triangular, Hamming, Hanning, Chebyshev, Kaiser. 
4. Window duration in samples. 


From the filter specifications the sequences / (m) and w() of Eq. (1) are computed, and the windowed 
filter is obtained as the final output. 


2.1 Form of the Windows 
The seven windows used in this program are 

1. Rectangular Window 

Triangular Window 

Hamming Window 

Hanning Window 

Generalized Hamming Window 

Kaiser (I\-Sinh) Window 

Chebyshev Window 


ee eS) 
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The form of each of these windows (assuming they are symmetric around n=0) is: 


Rectangular Window 
For N odd w(n)=1 —(N-1)/2 < 1 < (N-1)/2 (2a) 


For Neven, w(n) =1 —(N/2) < n < (N/2-1) (2b) 


Triangular Window 


For N odd, w(n) = 1— |2n|/(N+1) —(N-1)/2 < n < (N-1)/2 (3a) 
For Neven, w(n) =1— |2n+1|/N —(N/2) < n < (N/2-1) (3b) 
Hamming Window 

For N odd, w(n) = 0.54 + 0.46 cos[2zn/(N—-1)] —(N-1)/2 <n < (N-1)/2 (4a) 
For Neven, w(n) = 0.54 + 0.46 cof get =(N/2) <n < (N/2-1) (4b) 
Hanning Window 

For N odd, w(n) = 0.5 + 0.5 cos[2a7n/(N+1)] —(N-1)/2 < n < (N-1)/2 (Sa) 

2x (2n+1) vi = 

For Neven, w(n) =0.5 + 0.5 cos N+) (N/2) < n < (N/2-1) (Sb) 
Generalized Hamming Window 

For N odd, w(n) =a + (1-a)cos [27n/(N-1)] —(N-1)/2 < n < (N=1)/2 (6a) 
For Neven, —w(n) =a + (1-a)cos [sae -(N/2) <n < (N/2-1) (6b) 


where a is variable parameter. 


4n 
io [ile | 
SENN AWE en NE? 


Kaiser (1p-Sinh) Window 


For N odd, wn) = TB) (Ta) 
ide fi 
For Neven, w(n) = —(N/2) <n < (N/2-1) (7b) 
1)(8) 


where £ is window parameter related to desired minimum stopband attenuation [4]. 

Chebyshev Window 

w(n) is obtained as the inverse DFT of the Chebyshev polynomial, evaluated at N equally spaced fre- 
quencies around the unit circle [2,3]. The parameters of the Chebyshev window are the ripple, 6,, the 


filter length, N, and the normalized transition width, AF. Figure 1 shows a plot of the frequency 
response of a Chebyshev window illustrating how 6, and AF are measured. 
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Fig. 1 Definition of Chebyshev window parameters in the frequency domain. 


Only 2 of the 3 parameters N, 5, and AF can be independently specified. If the parameters 6, and 
AF are specified, then N is determined by the equation 


1+6, 
ey p 
cosh | 3 | 


(8) 
eet 
cos(7AF) 


N21+ 
cosh™! | 


If the parameters N and 6, are specified, then AF is determined as 


AF =~ cos! (9) 
T 
Finally if the parameters N and AF are specified, then 6, is determined as 
5, u (10) 
= fl aoe | | 
cstv 1)cosh {sta 1 


3. Program Description 
3.1 Usage 


The program consists of a main program and eleven subroutines. The main program reads the input 
data (i.e., the filter parameters discussed above), and the program prints the filter parameters, the win- 
dow coefficients, and the resulting impulse response of the digital filter (stored in array G). User 
prompts are given to aid in the input stage of the program. 


3.2 Description of Input Parameters 


CARD 1: NF, ITYPE, JTYPE 
FORMAT: (14,12,12) 


NF — The filter length in samples. NF must satisfy the relation 3 < NF < 1024. For 
highpass or bandpass filters NF must be odd. 


ITYPE — The window type. Values of ITYPE from | to 7 correspond to rectangular, triangular, 


Hamming, generalized Hamming, Hanning, Kaiser, and Chebyshev windows, respec- 
tively. 


JTYPE — The filter type. Values of JTYPE from 1 to 4 correspond to LP (lowpass), HP 
(highpass), BP (bandpass), and BS (bandstop) designs, respectively. 


If STYPE = 1 or JTYPE = 2, CARD 2: FC 
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If JTYPE = 3 or JTYPE = 4, CARD 2: FL, FH 
FORMAT: (2F14.7) 


FC — Normalized filter cutoff frequency for lowpass and highpass filters. FC is normalized to 
the range 0 < FC < 0.5. (See Figure 2). 
IDEAL LOWPASS FILTER 
‘4 


(a) 


°9 FC Os 


IDEAL HIGHPASS FILTER 


° FC Os 
Fig. 2 Definition of normalized cutoff frequency, FC, for (a) an ideal lowpass and, (b) an ideal highpass filter. 


FL,FH — Normalized filter cutoff frequencies for bandpass filters and bandstop filters. FL and 
FH are normalized so that 0 < FL < FH < 0.5. (See Figure 3). 
IDEAL BANDPASS FILTER 


° FL FH 05 


IDEAL BANDSTOP FILTER 


(b) 


°9 FL FH as 


Fig. 3. Definition of normalized cutoff frequencies, FL and FH, for (a) an ideal bandpass, and, (b) an ideal bandstop filter. 


If ITYPE = 4, CARD 3: ALPHA 
If ITYPE = 6, CARD 3: ATT 
If ITYPE = 7, CARD 3: DPLOG,DF 


FORMAT: (2F14.7) 
ALPHA — Parameter of the generalized Hamming window. 


ATT —_ The desired minimum stopband attenuation in dB (from which the parameter B of the 
Kaiser window is determined). 


DPLOG,DF — Ripple and transition width parameters for Chebyshev window designs. DPLOG 
is the desired filter ripple (on a decibel scale) and DF is the normalized transition 
width of the filter (0<DF<0.5). For Chebyshev windows exactly 2 of the 3 parame- 
ters NF,DP, and DF must be specified. The unspecified parameter (input set to 0) is 
determined analytically. 


CARD 4: IWIN 
FORMAT: (11) 
IWIN —_ IWIN is set to 1 to print w(v). 
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CARD 5S: IMD 

FORMAT: (11) 

IMD — __IMD is set to 1 to design a new filter, IMD is set to 0 to terminate the program. 
3.3 Description of Main Program (WINDOW) and Subroutines 


Main Program (WINDOW) — This program reads in filter parameters, determines the window and 
the ideal lowpass filter response, computes the windowed digital filter coefficients, transforms the 
lowpass filter to the specified filter type, writes out the filter coefficients and determines filter bandedges 
and ripples within each band. As an option it will also write out the window coefficients. 


TRIANG — This subroutines creates a triangular window. 

HAMMIN — This subroutine creates a generalized Hamming window. 

KAISER — This subroutine creates a Kaiser window. 

INO — This function evaluates /,(x) [4]. 

CHEBC — This subroutine computes the unspecified parameter of a Chebyshev window. 


CHEBY — This subroutine creates a Chebyshev window. 


FLCHAR — This subroutine computes a high resolution frequency response of the resulting 
filter using a DFT algorithm. For all window designs (except the triangular win- 
dows for which no ripple or bandedges are readily obtained) each ideal filter band 
is searched for the peak ripple and the bandedge. The bandedge is defined as the 
point where the frequency response crosses the ripple bound. A more precise 
estimate of the bandedge is determined by linear interpolation of the frequency 
response of the filter in the vicinity of the bandedge. Finally the ripple (i.e., 
peak deviation from the ideal response) is determined as 


Ripple = 20 log (1+8,,) 4B) for passbands 
Ripple = 20 log (6,) (GB) for stopbands. 


RIPPLE — This subroutine determines the filter ripples and bandedges from the filter param- 
eters and the high resolution frequency response. 


COSH — This function evaluates cosh (x). 
COSHIN — This function evaluates cosh™'(x). 
ARCCOS — This function evaluates cos~'(x). 


3.4 Dimension Requirements 
The dimensioned arrays are 


w- This array holds half of the window. (The second half is obtained by symmetry.) The 
size of W must be (NF+1)/2. 

Gr This array holds half the filter coefficients. (Symmetry is again used for the second 
half.) Its size must also be (NF+1)/2. 

PR — This array is only dimensioned in the subroutine CHEBY. It holds the real part of the 
DFT of the window. The size must be NF. 

PI - This array is only dimensioned in the subroutine CHEBY. It holds the imaginary part 


of the DFT of the window. The size must be NF. 


RESP — This array is only dimensioned in the subroutine FLCHAR. It holds the high resolu- 
tion frequency response of the filter. The size of RESP is 2048 points. 
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3.5 Summary of User Requirements 


(1) Specify filter parameters NF, ITYPE, JTYPE, FC (or FL,FH), and special window parameters 
DPLOG, DF (for Chebyshev windows), ALPHA (for generalized Hamming windows) and ATT 
(for Kaiser windows). 


(2) Design w(n), A(n) and f(n) using the main program which prints f(s), the filter coefficients, 
which are in array G, and optionally prints w(m) in array W. 


4. Test Problems 


The input data for a set of 7 windowed filter designs which exercises some of the types of windows 
and filters is given in Table 1. The output for each of these 7 cases is given in Tables 2-8, respectively. 
Test example 1 is a 25 point lowpass filter with ideal cutoff frequency of 0.3. A rectangular window is 
used for this case. Example 2 is the same as example 1 except a Hamming window is used, and the 
value of NF is increased to 30. Example 3 is a 25 point lowpass filter with ideal cutoff frequency of 0.3. 
This case uses a triangular window. Example 4 is a 56 point bandpass filter designed using a Kaiser 
window. The ideal bandedges of the filter are 0.15 and 0.35, and the window is designed for 60 dB 
minimum attenuation. Example 5 is a 55 point bandpass filter designed using a Chebyshev window. 
The ideal bandedges are 0.15 and 0.35, and the peak stopband tipple is specified to be 60 dB (0.001 on 
a linear scale). The transition width of the window is unspecified (set to 0.) as this is the free parame- 
ter of the Chebyshev window for this run. Example 6 is a bandstop filter designed using a Chebyshev 
window. The filter length is unspecified (set to 0) and is determined from the specified ripple (60 dB) 
and transition width (0.05) for the window. The bandedges of the filter are 0.15 and 0.35. The last 
example is a 55 point highpass filter designed using a Kaiser window, The minimum stopband attenua- 
tion is 60 dB, and the ideal cutoff frequency of the filter is 0.35. Figures 4 to 7 show plots of the win- 
dow (part a), the window frequency response (part b), the filter impulse response (part c) and the filter 
frequency response (part d) for examples 2, 5, 6, and 7. 


1 
(a) ' 


(a) 


VALUE 
VALUE 


° TIME IN SAMPLES ° 
(b) 


: 
i 
z 


(b) 


LOG MAGNITUDE (dB) 


FREQUENCY 05 


(c) te) 


VALUE 
VALUE 


° TIME IN SAMPLES bid 
= 0 
3 (a) 
8 
£ 
3 
= 
8 
5-100 
° FREQUENCY 05 
Fig. 4 Responses of the window (parts a and b) and the Fig. 5 Responses of the window (parts a and b) and the 
resulting filter (parts c and d) for example 2. resulting filter (parts c and d) for example 5. 
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3 z 
2 
3 
§ 8 
3 -s 
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5 (c) 
s 
s 
2 
t 4 4 1 iJ 
z A TIME IN SAMPLES 
3 3 
g 3 rc) 
i i 
Sa rn He 
C FREQUENCY x - FREQUENCY o8 
Fig. 6 Responses of the window (parts a and b) and the Fig. 7 Responses of the window (parts a and b) and the 
resulting filter (parts c and d) for example 6. resulting filter (parts c and d) for example 7. 


The listing of the main program and subroutines is given in the Appendix. 
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RECTANGULAR WINDOW-NF= 25 


WINDOW VALUES 
we 


**LOWPASS FILTER DESIGNe+ 


IDEAL LOWPASS CUTOFF= 


PASSBAND CUTO! 
STOPBAND CUTO! 


Table 1 
25141 
0.3 
1 
1 
3031 
0.3 
1 
1 
2521 
0.3 
1 
1 
5663 
0.15 -05 
60. 
1 
1 
55.7 3 
0.15 35 
60. 0. 
1 
1 
074 
0.15 35 
60. +05 
1 
1 
55 62 
0.35 
60. 
1 
C) 
Table 2 
1)= .10000000E 01 =w( 
2)= .10000000E 01 =w( 
3)= .10000000E 01 =w( 
4)= .10000000E 01 =w( 
5)= .10000000E 01 =w( 
6)= .10000000E 01 =w( 
7)= .10000000E 01 =w( 
8)= .10000000E 01 =w( 
9)= .10000000E 01 =w( 
10)= .10000000E 01 =w( 
11)= .10000000E 01 =w( 
12)= .10000000E 01 =w( 
13)= .10000000E 01 =w( 
- 3000000 


1)= -.15591270E-01 =H( 
2)= .27521070E-01 =H( 
3)= ~.27820390E-06 
4)= -.33636670E-01 
5)= .23387470E-01 
6)= .26728050E-01 
7)= -.50455220E-01 
8)= .27820390E-06 
9)= .75682580E-01 
10)= -.62366210E-01 
11)= -.93548720E-01 
12)= .30273090E 00 
13)=  .60000000E 00 =H( 
FF +2807 HZ RIPPLE 
FF +3176 HZ RIPPLE 
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25) 
24) 
23) 
22) 
21) 
20) 
19) 
18) 
17) 
16) 
15) 
14) 
13) 


25) 
24) 
23) 
22) 
21) 
20) 
19) 
18) 
17) 
16) 
15) 
14) 
13) 
-643 DB 
-19.677 DB 


Chapter 5 


Section 5.2 


Table 3 


HAMMING WINDOW-NF= 30 
ALPHA= -5400000 


WINDOW VALUES 


w( 1)= .80000100E-01 =w( 
W( 2)= .90754870E-01 =w( 
W( 3)= .12251590E 00 =w( 
W( 4)= .17379830E 00 =w( 
W( 5)= .24220310E 00 =w( 
WC 6)= .32453290E 00 =w( 
W( 7)= .41693830E 00 =w( 
wW( 8)= .51509700E 00 =w( 
W( 9)= .61442080E 00 =w( 
W( 10)= .71026440E 00 =w( 
W(11)= .79814640E 00 =w( 
W( 12)= .87395820E 00 =w( 
W( 13)= .93415440E 00 =w( 
W( 14)= .97592040E 00 =w( 
W( 15)= .99730340E 00 =w( 

**LOWPASS FILTER DESIGN+* 

IDEAL LOWPASS CUTOFF= + 3000000 
H( 1)= .14208050E-02 =H( 
H( 2)= .66123040E-03 =H( 
H( 3)= -.31198420E-02 =H( 
H( 4)= .14865990E-02 =H( 
H( 5)= .59401210E-02 =H( 
H( 6)= ~.87972210E-02 =H( 
H( = 7)= -.48247580E-02 =H( 
H( 8)= .21861400E-01 =H( 
H( 9)= -.92980680E-02 =H( 
H( 10)= -.33255520E-01 =H( 
H( 11)= .45675080E-01 =H( 
H( 12)= .24561290E-01 =H( 
H( 13)= -.11894020E 00 =H( 
H( 14)= .63996670E-01 =H( 
H( 15)= .51364740E 00 =H( 


PASSBAND CUTOFF 
STOPBAND CUTOFF 


TRIANGULAR WINDOW-NF= 25 


WINDOW VALUES 


**LOWPASS FILTER DESIGN+#* 


IDEAL LOWPASS CUTOFF= 


30) 
29) 
28) 
27) 
26) 
25) 
24) 
23) 
22) 
21) 
20) 
19) 
18) 
17) 
16) 


30) 
29) 
28) 
27) 
26) 
25) 
24) 
23) 
22) 
21) 
20) 
19) 
18) 
17) 
16) 


+2413 HZ RIPPLE «020 DB 

.3563 HZ RIPPLE -50.398 DB 

Table 4 
1)=  .76923130E-01 =w( 25) 
2)= .15384620E 00 =w( 24) 
3)= .23076930E 00 =w( 23) 
4)= .30769230E 00 =w( 22) 
5)= .38461540E 00 =w( 21) 
6)= .46153850E 00 =w( 20) 
7)= .53846160E 00 =w( 19) 
8)= .61538460E 00 =w( 18) 
9)= .69230770E 00 =W( 17) 
10)= .76923080E 00 =w( 16) 
11)= .84615390E 00 =w( 15) 
12)= .92307690E 00 =w( 14) 
13)=  .10000000E 01 =w( 13) 

+ 3000000 

1)= -.11993290E-02 =H( 25) 
2)= .42340080E-02 =H( 24) 
3)= -.64200890E-07 =H( 23) 
4)= -.10349750E-01 =H( 22) 
5)= .89951790E-02 =H( 21) 
6)= .12336020E-01 =H( 20) 
7)= -.27168200E-01 =H( 19) 
8)= .17120240E-06 =H( 18) 
9)= .52395630E-01 =H( 17) 
10)= -.47974010E-01 =H( 16) 
11)= -.79156580E-01 =H( 15) 
12)= .27944390E 00 =H( 14) 
13)= .60000000E 00 =H( 13) 
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FIR Programs 


KAISER WINDOW-NF= 
ATT= 60.0000000 
WINDOW VALUES 


W( 28)= 
**BANDPASS FILTER D! 
IDEAL CUTOFF FREQUE! 
i= 
2)= 
H( 3)= 


28)= 
STOPBAND CUTOFF 
PASSBAND CUTOFFS 
STOPBAND CUTOFF 


Table 5 

56 

BETA= 5.6532570 
+20388090E-01 =w( 56) 
-33787730E-01 =w( 55) 
+50466800E-01 =w( 54) 
-70650820E-01 =w( 53) 
-94510080E-01 =w( 52) 
+12215050E 00 =w( 51) 
+15360570E 00 =w( 50) 
+18883060E 00 =w( 49) 
+22769680E 00 =w( 48) 
-26999030E 00 47) 
-31541080E 00 46) 
-36357260E 00 45) 
-41401090E 00 44) 
+46618500E 00 =w( 43) 
-51949130E 00 =w( 42) 
+57326480E 00 =w( 41) 
-62680230E 00 =w( 40) 
+67936970E 00 =w( 39) 
+73021390E 00 =w( 38) 
+77858810E 00 =w( 37) 
-82375820E 00 =W( 36) 
-86502400E 00 =w( 35) 
+90173230E 00 =w( 34) 
+93329350E 00 =w( 33) 
+95919230E 00 =w( 32) 
+97900370E 00 =w( 31) 
+99239710E 00 =w( 30) 
-99915160E 00 =wW( 29) 
ESIGN** 
NCIES= 1500000 - 3500000 
+33373340E-03 =H( 56) 
-46434790E-03 =H( 55) 
+27529500E-03 =H( 54) 
+40115490E-03 =H( 53) 
+14646240E-02 =H( 52) 
+24439120E-02 =H( 51) 
+26018560E-02 =H( 50) 
+12813520E-02 =H( 49) 
-16243030E-02 =H( 48) 
+53150390E-02 =H( 47) 
+81133020E-02 =H( 46) 
-80248120E-02 =H( 45) 
+37155130E-02 =H( 44) 
+44724530E-02 =H( 43) 
+14014040E-01 =H( 42) 
+20645000E-01 =H( 41) 
-19849570E-01 =H( 40) 
+90004760E-02 =H( 39) 
+10692340E-01 =H( 38) 
33359160E-01 =H( 37) 
-49442590E-01 =H( 36) 
+48466250E-01 =H( 35) 
+22806540E-01 =H( 34) 
+28850660E-01 =H( 33) 
+99806550E-01 =H( 32) 
17628290E 00 =H( 31) 
24094420E 00 =H( 30) 
-27797700E 00 =H( 29) 

+1171 HZ RIPPLE -59.714 DB 

+1825 HZ +3174 HZ RIPPLE 

+3832 HZ RIPPLE -61.655 DB 
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~012 DB 


Section 5.2 


Table 6 
CHEBYSHEV WINDOW-NF= 55 
DP= -0010000 DF= 0446622 
WINDOW VALUES 
wW( 1)= .22114040E-01 =w( 55) 
W( 2)= .23350940E-01 =W( 54) 
W( 3)= .34994060E-01 53) 
W( 4)= .49832560E-01 52) 
w( 5)= .68227770E-01 51) 
wt 6)= .90503870E-01 50) 
wW( 7)= .11691700E 00 =w( 49) 
Wi 8)= ,14763970E 00 =w( 48) 
wW{ 9)= .18275320E 00 =w( 47) 
W( 10)= .22222850E 00 =w( 46) 
W(11)= .26590410E 00 =w( 45) 
W( 12)= .31350470E 00 =w( 44) 
W( 13)= .36460550E 00 =w({ 43) 
W( 14)= .41867210E 00 =W( 42) 
wW( 15)= .47501970E 00 =w( 41) 
W(16)= .53289100E 00 =w( 40) 
W(17)= .59138560E 00 =w( 39) 
W( 18)= .64956160E 00 =w( 38) 
W(19)= .70639290E 00 =w( 37) 
W( 20)= .76085360E 00 =w( 36) 
W( 21)= .81189510E 00 =w( 35) 
W( 22)= .85851200E 00 =w( 34) 
W( 23)= .89975800E 00 =w( 33) 
W( 24)= .93478490E 00 =w( 32) 
W( 25)= .96284500E 00 =w( 31) 
W( 26)= .98333280E 00 =w( 30) 
W( 27)= .99580760E 00 =w( 29) 
W( 28)= .10000000E 01 =w( 28) 
**#BANDPASS FILTER DESIGN+* 
IDEAL CUTOFF FREQUENCIES= -1500000 -3500000 
H( 1)= .10587540E-07 =H( 55) 
H( 2)= .33606800E-03 =H( 54) 
H( 3)=  .73327410E-13 =H( 53) 
H( 4)= .77696800E-03 =H( 52) 
H( 5)= -.32665510E-07 =H( 51) 
H( 6)= -.24907520E-02 =H( 50) 
H( 7)= .34595170E-07 =H( 49) 
H( 8)= -.15649260E-07 =H( 48) 
H( 9)= .54076300E-07 =H( 47) 
H( 10)= .74750520E-02 =H( 46) 
H( 11)= -.12730700E-06 =H( 45) 
H( 12)= -.73319790E-02 =H( 44) 
H( 13)= -.45840200E-12 =H( 43) 
H( 14)= -.11190420E-01 =H( 42) 
H( 15)= .22742580E-06 =H( 41) 
H( 16)= .26887070E-01 =H( 40) 
H( 17)= -.17498860E-06 =H( 39) 
H( 18)= .68851140E-07 =H( 38) 
H( 19)= -.20901980E-06 =H( 37) 
H( 20)= -.57583410E-01 =H( 36) 
H( 21)= .38871140E-06 =H( 35) 
H( 22)= .53541870E-01 =H( 34) 
H( 23)= .37707510E-12 =H( 33) 
H( 24)= .87448120E-01 =H( 32) 
H( 25)= -.46098210E-06 =H( 31) 
H( 26)= -.29768500E 00 =H( 30) 
H( 27)= .29465610E-06 =H( 29) 
H( 28)= .40000010E 00 =H( 28) 
STOPBAND CUTOFF -1073 HZ RIPPLE -67.961 DB 
PASSBAND CUTOFFS +1915 HZ +3082 HZ RIPPLE 
STOPBAND CUTOFF -3924 HZ RIPPLE -67.961 DB 
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.004 DB 


FWFIR 


FIR Programs 


Table 


us 


Chapter 5 


NF MUST BE ODD INTEGER FOR HP OR BS FILTERS--NF IS BEING INCREASED BY 1 
CHEBYSHEV WINDOW-NF= 51 


«3500000 


.002 DB 


.3024 HZ RIPPLE 


DP= +0010000 DF= «0500000 

WINDOW VALUES 
w( 1)= .16471760E-01 =W( 51) 
W( 2)= .20148630E-01 =w( 50) 
W( 3)= .31728420E-01 =w( 49) 
W( 4)= .46980540E-01 =w( 48) 
W( 5)= .66402670E-01 =w( 47) 
W( 6)= .90445820E-01 =W( 46) 
WC 7)= .11946230E 00 =w( 45) 
W( 8)= .15370090E 00 =w( 44) 
W( 9)= .19324890E 00 =w( 43) 
W( 10)= .23803970E 00 =w( 42) 
W( 11)= .28783570E 00 =w( 41) 
W( 12)= .34218940E 00 =W( 40) 
W( 13)= .40046500E 00 =w( 39) 
W( 14)= .46183130E 00 =W( 38) 
W( 15)= .52529320E 00 =W( 37) 
W( 16)= .58969080E 00 =W( 36) 
W( 17)= .65375500E 00 =w( 35) 
W( 18)= .71612070E 00 =W( 34) 
W( 19)= .77539310E 00 =W( 33) 
W( 20)= .83018530E 00 =W( 32) 
W( 21)= .87916110E 00 =w( 31) 
W( 22)= .92110100E 00 =w( 30) 
W( 23)= .95491870E 00 =w( 29) 
W( 24)= .97973990E 00 =w( 28) 
W( 25)= .99489920E 00 =wW( 27) 
W( 26)= .10000000E 01 =W( 26) 

**BANDSTOP FILTER DESIGN+* 

IDEAL CUTOFF FREQUENCIES= «1500000 
H( 1)= -.34515350E-13 =H( 51) 
H( 2)= -.31414860E-03 =H( 50) 
H( 3)= .15190660E-07 =H( 49) 
H( 4)= .12929490E-02 =H( 48) 
H( 5)= -.19648240E-07 =H( 47) 
H( 6)= .95869230E-08 =H( 46) 
H( 7)= -.35348630E-07 =H( 45) 
H( 8)= -.51700030E-02 =H( 44) 
H( 9 .»92521820E-07 =H( 43) 
H( 10)= .55670700E-02 =H( 42) 
H( 11)= .36188270E-12 =H({ 41) 
H( 12)= .91461610E-02 =H( 40) 
H( 13)= -.19173110E-06 =H( 39) 
H( 14)= -,.23301740E-01 =H( 38) 
H( 15)= .15543210E-06 =H( 37) 
H( 16)= -.62505020E-07 =H( 36) 
H( 17)= .19344440E-06 =H( 35) 
H( 18)= .54197900E-01 =H( 34) 
H( 19)= 37123540E-06 =H( 33) 
H( 20)= 51775250E-01 =H( 32) 
H( 21)= -.36844320E-12 =H( 31) 
H( 22)= -.86167990E-01 =H( 30) 
H( 23)= .45718720E-06 =H( 29) 
H( 24)= .29659740E 00 =H( 28) 
H( 25)= -.29438730E-06 =H( 27) 
H( 26)= .59999990E 00 =H( 26) 

PASSBAND CUTOFF -1030 HZ RIPPLE 

STOPBAND CUTOFFS +1974 HZ 

PASSBAND CUTOFF .3968 HZ RIPPLE 
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.002 DB 


-73.147 DB 


Section 5.2 


KAISER WINDOW. 
ATT= 60.01 
WINDOW VALUES 


**HIGHPASS FI. 
IDEAL HIGHPAS: 


STOPBAND CUTO! 
PASSBAND CUTO! 


Table 8 


I-NF= 55 


000000 BETA= 5. 


1)= .20388090E-01 
2)= .34066010E-01 
3)= .51150610E-01 
4)= .71878610E-01 
5)= .96427080E-01 
6)= .12490300E 00 


7)= .15733500E 00 =w( 
8)= .19366690E 00 =w( 
9)= .23375280E 00 =w( 
10)= .27735250E 00 =w( 
11)= .32413550E 00 =w( 
12)= .37367830E 00 =wW( 
13)= .42547510E 00 =w( 
14)= .47893880E 00 =W( 
15)= .53341600E 00 =w( 
16)= .58819190E 00 =wW( 
17)= .64251240E 00 =w( 
18)= .69559720E 00 =wW( 
19)= .74664920E 00 =w( 
20)= .79488300E 00 =w( 

21)= .83953300E 00 =w( 

22)= .87987460E 00 =w( 
23)= .91524270E 00 =w( 
24)= .94504490E 00 =w( 
25)= .96877100E 00 =w( 
26)= .98601800E 00 =w( 
27)= .99648990E 00 =wW( 
28)= .99999900E 00 =w( 

LTER DESIGN+* 

'S CUTOFF= +3500000 
1)= -.74281390E-04 =H( 
2)= -.24513290E-03 =H( 
3)= .65126990E-03 =H( 
4)= -.56036520E-03 =H( 
5)= -.41235770E-03 =H( 
6)= .17187140E-02 =H( 
7)= -.19293910E-02 =H( 
8)= .59010880E-07 =H( 
9)= .31681480E-02 =H( 
10)= -.46646410E-02 =H( 
11)= .18755650E-02 =H( 
12)= .43695570E-02 =H( 
13)= -.90288630E-02 =H( 
14)= .64007230E-02 =H( 
15)= .40358830E-02 =H( 
16)= -.14838590E-01 =H( 
17)= .15041810E-01 =H( 
18)= -.21195050E-06 =H( 
19)= 21363840E-01 =H( 

20)= .30079520E-01 =Hi 

21)= 11797260E-01 =H( 

22) 27436900E-01 =H( 
23)= .58266170E-01 =H( 
24)= -.44204220E-01 =H( 
25)= -.31763530E-01 =H( 
26)= .14924880E 00 =H( 
27)= -.25661440E 00 =H( 
28)= .30000070E 00 =H( 
FF .3164 HZ RIPPLE 

FF +3834 HZ RIPPLE 


5.2-13 


6532570 


=W( 


55) 
54) 
53) 
52) 
51) 
50) 
49) 
48) 
47) 
46) 
45) 
44) 
43) 
42) 
41) 
40) 
39) 
38) 
37) 
36) 
35) 
B4) 
33) 
32) 
31) 
30) 
29) 
28) 


55) 
54) 
53) 
52) 
51) 
50) 
49) 
48) 
47) 
46) 
45) 
44) 
43) 
42) 
41) 
40) 
39) 
38) 
37) 
36) 
35) 
34) 
33) 
32) 
31) 
30) 
29) 
28) 


-59.842 DB 


-008 DB 


FWFIR 


USLTId YOd SSNOdSIX SSTNAWI (GEMOGNIMNA) IvaaGI aLNaWoo > 


2 
SQNILNOD 08 
t = O81 
z/(aN+l) = N 
| + 4N = aN 
val (AG GSSvaYONI ONTEa SI HDZ + 
~ “4N--SYaLTId Sa YO aH €4Od YSOSINI ado 3a LSOW aN HE?) LYWHOd 0666 
2 (0666*tG920) azTEM 
= 08 OL OD (€*Oa"adkLE “YO” b°OF'SdALE *YO" |*Oa"OSI) aI 
A] (Z*aN)GOW = O3I 04 
1S) 2 
ado 4YOd | = OSI ‘NEAZ Yoda 0 = OI “WOLVOIGNI dado ‘NSA NV SI ogI 3 
2 
(NX ‘OX *N ‘aq ‘dd *4N)DaaHD TIvD 
(0°0Z/D01dd-)**0°0L = aa 
4d ‘S01da (€666'GOONT) avay 
((4°¥L4)HLGIM NOILISNVEL HPZ* 
“MO/ONY (4° P14) GQ NI QIddI¥ ASHSAGSHD AgIOGdS HOP) LYWYOR L666 
(1666"taot0) auTum 
3 
“SON1VA OW3Z 3HL HLIM NI avau sIo 
NSLAWVUVd GETAIOSdSNA SHL “HIONAT UaL'IId 3HL SI aN GNV > 
*YawIIa SHL 40 (GSZI1VWYON) HLGIM NOILISNVHL 3HL SI aq > 
“(21VOS Ga)aiddIy ALIA Ga¥ISd FHL SI O01dd aWAHM ‘GaTaIOgas 3a 4SAW > 
ad dNY ‘Soda ‘4N SUBLaWVUVd € SH JO Z--MOGNIM ASHSAGSHD YOd anaNI > 
2 
04 OL OD (4*SN"SdALI) aI 09 
0S OL 0D 
(viva HS s 
“NSINGSY HE ‘4 "id ‘=T4 NVHL BATIVHS SI HOZ ‘L*PLa ‘=Ha HY) ZYMHOR z666 
‘Td “HA (2666°1GOL0) SLIMM (T4°LT"Ha) aI 
Hd (S666*1GDL0) SLIM (¢*0°LO"HA HO’ ‘O'LI'HA) aI 
‘Td (S666*LGOLO) BLIUM (S*O°LD"Ia "HO" *O'LI"Ia) aI 
09 OL OD (1a"LO"Ha ‘aNV’ e 
S°O°WT'Hd “GNV" O° O°LO"Ha “GNY’ S*O°LT"Id “GNV’ O"O'~O"Ta) ar 
(4*hlaz) LvW¥od C666 
Ha “1a (€666'GOONI) avay 
( (HE . 
“G'WLaz)HL ‘SATONENOSYA 4dOLND Waddn ANY WAMOT AATOSAS HEP) LYMYOR YEEE 
(¥666*tGoL0) aLTEM 05 
5) 
Hd GNV Id LO4NI - NOISAG dOLSGNVa YO SSvaGNYa ‘IvaaI aHL wos > 
2 
OF OL 09 
* wine + 
“Vd NaINASY *SGNNOG JO ZNO SI H6z *L*hLa ‘=94 dO BNIVA HEL) LYMHOR S66E 
D4 (S666*LG9L0) 3LTuM 
09 O£ 09 (S*0°LT"Da “GNV* 0°0°L9"Da) aT 
24 (€666'GOONT) avau 
((L*vld)AONANOTYA 440LND TWEGI AaIOTES HBE) LYWYOR 9666 
(9666‘1doL0) azTum oF 
2) 
O4 LAdNI - NOISSC SSvdHOTH ¥O SSVdMO1 ‘IVdGI 3HL 4Oa O 
2 
OS OL OD (Z*SN"adkEC “GNV’ L*aN"SdALC) aT 
a @/(t+aN) = N 
2 
2 MaL11d OIMLEWWAS 3HL 40 HLONGT SHL d'IVH SIN OD 
a 
¢ 0% OL OD ((Z*Og"aN *HO* L*OR"4N) ‘GNV’ Z°Oa*SdALI) aI 
[-%) 02 OL OD (€°L1'4N “GNV* “°aN'adALI) 42 Of 
fe 01 OL 09 
= (SQNNO@ 40 £AO SI HLL ‘PI ‘=4N HE) LYWUOa L666 


4N (L666*ZG910) aLIuM 


O€ OL OD (¥ZOL*aT*aN) at 


(ZI ‘21 ‘pI) LyWwyod 8666 


SdALC *SdALI ‘AN (8666'COONI) avau 

((@I)aaan wHOL * 

“SLUd W9 **(ZI)3d4L MOGNIM 
(6666*LG9L0) 3LINM OL 


(AdkLC)SdAL YALA GNV (SdALI)adAL MOGNIM *(4N)HLONAI WILE SHL LAaNI 
(Z)HOWWLI = ZaoLO 
(P)HOWWLI = LaoLoO 
(L)HOWWLI = GOONT 
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CUVGNVES GHL NO NSLLIUM SI LNdino 117 
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“MAMSNV SHL NI Sadik WISN GHL GNV (LGOLO) TYNIWYEL 
NSN GHL NO NALLIYM SI NOTLSENO V - SI LYHL 
SAILOVUSLNI-WISN SI WYHOOUd SIHL OL NANI :LNaNr 
$8d09 SOIAgG O/I aNIaga 


Ide0°% = TdOML 
(O° L)NVEVeO"® = Ia 


Zd9L0 *1d9L0 YaOaLNI 
(Z1S)9 *(Z1S)M NOTSNaWIG 


WYHOOUd SSLVNIWYSL 0 = GWI 
NOU MEN 1 = GWI 

SNQY IVNOILIGGv Sisanoay awI 
GNIYd | = amr 


SINIWd LON OG 0 = dMI 

SAN 1VA MOGNIM SHL LNO SLNIUd ATIVNOTLdO amr 
S*0 => Hd => Id => 0 

S@IOQNSNOAYA AdOLND WALIIA GSZITVWYON BHL ABV Ha GNV ‘Ta 
S°0 => Od => 0 


AONENOMA 440LND GIZIIVWHON BHL SI D4 
4aL11d dOLsanva v= ganic 
4aaL1I4 ssvaanva € = ganic 
MSLIId SSvaHOIH @ = ganic 

UaLIId SSVaMOT t= gdauc 
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Design Subroutine (MXFLAT) for Symmetric FIR Low Pass 
Digital Filters with Maximally-Flat Pass and Stop Bands 


J. F. Kaiser 


Digital Systems Research Dept. 
Bell Laboratories 
Murray Hill, NJ 07974 


1. Purpose 


The program is designed to give the coefficients of a maximally-flat pass and stop band symmetric FIR 
low pass digital filter with an odd total number of terms. The design proceeds from the initial 
specification of the width and the center of the transition band. 


2. Method 


In those situations where a low pass (smoothing) filter with a monotonic frequency response charac- 
teristic [1] is necessary the MXFLAT routine gives the coefficients of the desired filter. The MXFLAT 
designs are characterized by a tangency of the filter magnitude-frequency characteristic of L’th order at 
zero frequency and X’th order at half sampling frequency. The combined order is thus 2(K+L-1). 


The frequency response characteristic of a symmetric FIR low pass digital filter having a maximally-flat 
magnitude characteristic is given [2-5] by 


HQ) = -y) oe y" a) 
where 
y = [1 —cos(2rf/f,)]/2 (2) 
and 


K = order of tangency at f = f,/2 
L = order of tangency at f = 0 
J, = sampling frequency in Hz 


Equation (1) is rewritten in a form more convenient for calculation as 


K=1 ‘a 
T]a+ | y” 6) 
a= (i=t 


Nyp-K 
Hy) = (-y)*k [1+ 5 | 


where 
Ny; = K+L-—1 = the half-order of the filter. 


To find the actual coefficients of the filter having the magnitude characteristic given by Eq. (1) with the 
substitution Eq. (2) it is necessary to rewrite H(y) in the form 


Ny 
H(/) =B(1) + § 2B(n+1) cos2mnf/f,) (4) 


n=l 
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The resulting filter coefficients can then be used directly to filter data; the filtered output data y, is cal- 
culated from the original input data x, as 

Yn = BU)X_ + B(2) (p41 + Xn—1) + BOB) (p42 + Xp—2) + +++ + BNP) (Xp 4np—1 + Xe—wpvr) (5) 
where B(x) is the array of filter coefficients and NP = N; + 1. 


FILTER SPECIFICATION DEFINITIONS 


AMPLITUDE 


NORMALIZED FREQUENCY 


Fig. 1 Definitions of 8 and y used in the design of maximally-flat FIR filters. 


Referring to Fig. 1 the specification of Ny determines the sharpness of cutoff of the filter as measured 
by y, the normalized width of the transition region defined as the region where the filter magnitude 
response varies from 95% (passband edge) down to 5% (stopband edge). The location of the center, B, 
of the transition region is determined by the ratio K/Ny. For these filters all of the K zeros of 
transmission are located at f, /2 rather than being distributed throughout the stopband region as in the 
equiripple FIR designs. 


The design equation relating the width of the transition region to filter order is not known in closed 
form for this filter class. However it can be approximated [1] by 


1 
N-1=2N;= > (6) 
igi Fe 

where N—1 is the order of the filter and y is the normalized transition band width as measured by the 
region where the filter response magnitude varies from 95% (passband edge) down to 5% (stopband 
edge). Normalization is with respect to the sampling frequency. These filter parameters are shown in 
Fig. 1. 
Note that in this class of filters the number of terms required is inversely proportional to the square of 
the transition width whereas in the equiripple pass and stop band designs it is inversely proportional to 
only the first power of the transition width. These filter designs thus tend to require more terms fora 
given transition band width. 


3. Program Description 


The package consists of a main program and three subroutines - MXFLAT, PRCOEF, and RATPRX. 
The code for these routines is given in the Appendix. 


After reading in the values of 8 and y, the main program calls up» MXFLAT which computes the filter 
coefficients after determining the proper filter order through RATPRX. The filter coefficients are then 
printed out by PRCOEF. The program is dimensioned to handle up to a 398’th order filter. The 
dimension can be increased by changing the value of the variable LIMIT. 


The detailed design proceeds as follows: 


1. Specify 8, the normalized center of the transition band, and y, the normalized width of the transi- 
tion band; the normalization is with respect to the sampling frequency, i.e. 0<B<0.5, 
0<y< minimum (2B, 1-28). If 8 and y lie outside these limits the design routine prints out a 
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diagnostic to this effect and execution stops. Using the approximate design formula, Eq. (6), a 
lower estimate of the required filter order, N—1, is determined. 


2. The degree of tangency at zero frequency is then determined such as to give the desired location 
for the center, 8, of the transition region. The filter order is permitted to change by up to a factor 
of two over that determined in Step 1 in order to adjust the transition band center, f, to as close to 
the prescribed value as possible. 


3. The filter coefficients, B(I), are then determined by first evaluating the frequency response charac- 
teristic at an equally spaced set of frequency points and then performing an inverse discrete Fourier 
transform on this point set. Advantage is taken of the even symmetry in both the frequency 
response and the weighting coefficient sequence. This method of obtaining the coefficients 
simplifies the coding considerably. 


4. Test Problem 


An example of the use of this procedure is shown in Fig. 2. Here beginning with the desired 
specifications of 8 = 0.2 (center of transition band) and y = 0.1 (transition band width) a filter design 
was produced by MXFLAT with NP=26, N;=25, i.e. a filter with a span of 50 samples. The program 
printed output is displayed in Table 1. The filter coefficients are used according to Eq. (5). The actual 
resulting 8 was 0.198 and the y was 0.102 as could be determined from an evaluation of the frequency 
response characteristic. 


AMPLITUDE 


tole} O41 02 o3 04 05 
NORMALIZED FREQUENCY 


Fig. 2. Frequency response characteristic of maximally flat (MXFLAT) filter. 


Often in the resulting designs the last few filter coefficients will be virtually zero. This is especially true 

for s mall values of y. These coefficients can be set to zero and the order of the filter reduced accord- 
ingly. The net effect is to distribute the transmission zeros in the upper part of the stopband from their 
clustered position at half the sampling frequency. 


As a general rule the use of this program should be restricted to values of y not much smaller than 
0.05. For example with B=0.2 and y=0.05 the resulting filter had 110 coefficients (218 order), the last 
52 of which were smaller than 0.0000002 in magnitude. 
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Program output for 8 = 0.2, y = 0.1 


FOR BETA = 


NO. OF 
1 


DAURUN KH COCMIMRNEUN—CCMIRHEUN 


ee eee 


Table 1 


-200 AND GAMMA = . 
COEFS.= 26 

39847448 
29650429 
08785310 


05124769 


. 05604429 


00136329 


- 02472394 
-01120456 


00592278 


-00709112 
—.00061605 
. 00232969 
- 00113164 
. 00028640 
. 00043241 
- 00008700 
. 00006961 
. 00004320 
. 00000222 
- 00000624 
. 00000241 
- 00000007 
. 00000016 
- 00000002 
- 00000002 
.00000001 
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A Subroutine for Finite Wordlength FIR Filter Design 


Ulrich Heute 


Institut fuer Nachrichtentechnik 
Universitaet Erlangen-Nuernberg 
Cauerstr. 7 
D-8520 Erlangen, W. Germany 


1. Purpose 
FIR filters in direct form have a transfer function 
not 
H(z) = ¥ A(v)z" 
=) 


with the coefficients 4,(v) being identical to the impulse response of the finite length np. 

Linear-phase filters have a symmetrical impulse response, i.e., h,(v) = +h,(np—1—v); thus, only 

np+l 
2 . . 

frequency response, in this case, becomes purely real or purely imaginary, if a constant delay term is 

neglected. 


n=l ] different elements h,(v), v € {0,1,...,(m;—-1)} are needed for their description. The 


The subroutine IDEFIR /terative Design of Linear-Phase F/R Filters") finds these n, coefficients in a 
way that the frequency response with a rounded fixed-point version, R[h,(v)], of the coefficients 
fulfills a prescribed tolerance scheme. Rounding is carried out to the minimum possible wordlength. 
The tolerance schemes can be of the following types: 

- lowpass filters, 

- highpass filters, 

- symmetrical bandpass filters, 

- symmetrical bandstop filters, 

- HILBERT transformers. 
The tolerance schemes are described by sets of at most six parameters (8), 52; pj, 21; Qp2, 2,2}, the 
meaning of which is to be seen from the figures in [3]. All tolerances have to be constant; the sym- 
metry in the bandfilter cases includes identical tolerances in all passbands or all stopbands, respectively, 


and a center frequency at 9 = 0.25 = or = f= f,/4. 


2. Method 
2.1 Principal Idea 
The subroutine IDEFIR realizes a “modified iterative design" procedure as proposed in [1],[2]. 


The main idea is a CHEBYSHEV design of a linear-phase lowpass filter with exact (i.e., computer accu- 
racy) coefficients h,(v) for a transformed and reduced tolerance scheme such that the original require- 
ments are fulfilled with rounded coefficients R [h, (v)]. 


The appropriate reduction is found with the aid of a well-known filter length estimation [3],[4], an 
approximate statistical bound for the effective coefficient rounding error [1],(2],[5], and a minimum 
wordlength estimation derived from this error bound [1]; the "exact design" is carried out by calling any 
convenient lowpass design procedure, Iterations, with modified tolerance reductions, are provided 
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because of the statistical and approximate character of the estimations applied. 

2.2 Design Process 

The design process can easily be understood from the block diagram and the following explanations, 

concerning the numbered stages of the diagram: 

(1) Only the data of the tolerance scheme {51,52 »), 2 ,3(Q »2, 2 ,2)} are needed as input parame- 
ters. 

(2) Filters of the types named in Section 1 can all be derived from equivalent lowpass designs by sim- 
ple transformations (e.g., [4]). 

(3) The minimum wordlength w.. for the (transformed) specifications is estimated. 


(4) The filter length 1; is estimated from the specifications. 


(5) The rounding error effects S,,S2 in the passband and the stopband are estimated, taking into 


account the filter length, the wordlength, and the size of "ripples" Bios of the "exact coefficients" 
frequency response. This calculation, itself, is carried out iteratively (. 


(6) The estimated total errors, F, = 3, +S, F.= 3 + S>, are compared to the prescribed tolerances. 
If the assumption results that the tolerance scheme is fulfilled, a CHEBYSHEV design procedure is 
called. If the tolerances are assumed to be violated, the tolerances 5), 52 are reduced; the program 
jumps back to label* 20, and the estimations of n,, S\, and S2 are repeated. 

(7) Any convenient design routine can be applied, here. The filter length m,, of the first design itera- 
tion is stored for later comparisons (see point (9)!). 


(8) After coefficient rounding, the real maximum total errors Eyayj, Emax2 are compared to the 
specifications. If the tolerances are fulfilled, further checks follow (see comment (9a)!). If they 
are violated, a further reduction of 5), 2 is necessary, the program jumps back to label 20, (see 
point (6)!), and the (inner) design iteration loop is re-entered. 

(9) (a) The "exploitation" of the tolerances is checked: if less than a certain percentage p-100 (e.g., 
p = 0.9 = 90%) is used and the filter length exceeds the value n,, (see comments (9b) and (), 


the tolerances ie & may be enlarged; in this case, the program jumps back to label 20, as well. 
(b) If no solution was found for the filter length estimated in the first iteration (see point (7)!), 
the length for the first solution found at all takes the place of mp,. 


(10) Tolerance reductions and increases are carried out with different "damping factors" Ck, C;. 
(11) After a change of the design tolerances Di by it has to be checked, whether the scheme is realiz- 
able, at all. If negative tolerances result, the wordlength is too small. With an increased 


wordlength, the whole (outer) design iteration loop is re-entered, and the program jumps back to 
label 10. 


(12) The (exact and rounded) coefficients of the lowpass fulfilling the requirements are transformed to 
the desired filter type (see comment (2)!). Finally, their "actual wordlength" is determined, i.e., 
the number of bits needed for the sign and for the magnitude of the largest absolute coefficient 
value without leading zeros. 

3. Program Description 

3.1 Main Program 

A main program is needed calling the iterative design routine: 


CALL IDEFIR (DELI, DEL2, OMGP1, OMGS1, OMGP2, OMGS2, ITYP, NFOO, NF, IWCMIN, 
IWC, IWACT, DEL11, DEL21, EMAX1, EMAX2, HO, RHO, ITERA, IERR). 
The meanings of the parameters in the list are to be found in the "Comment"-part of the subroutine 


* The labels cited here and marked by encircled numbers in the block diagram, correspond to labels in the program listing. 
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Subroutine IDEFIR: Herative DEsign of FIR digital filters (direct form, linear phase) 


Input parameters: 6). 8. Mp, . Ms, , 


Check filter type: Lowpass/highpass/bandpass/bandstop/Hilbert 
Transformation to lowpass design parameters: 5, >. AN = 2, — Mp 


Minimum coefficient wordlength: w= = "a 
Inner design iteration loop: Design tolerances 5°) y= 8) 2 


Iterative calculation of the expected rounding errors $, » 
Esiimaved max, total errors: Fy x= 8,2 +S; 2 


Differences between total errors and tolerances: 4, 3 = Fy, > 5).3 


e 
a 


Storage of rp. = Mr, = Mr 


Design of FIR Chebyshev lowpass with exact 
coefficients for parameters ny. 8’, :. 40 


Rounding of coefficients 


Real max. total errors of the frequency response: E....\ > 


Differences between total errors and tolerances: 4) >= Emai.2~ 81. 


‘Change of the tolerances: 
Bx By 2— Cay Oia 


Increase of the wordlength: 
wom we +l 


Transformation of coefficients to the original filter type. 
Determination of the actual coefficient wordlength 


Output parameters: ny, wc, 8'),3. F_z, exact and rounded coefficients 


FWFIR 


» 


2 


» 


4) 


3) 


6) 


n 


” 


10) 


m 


12) 


Figure 1 
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listing. 


This main program has to provide the input and output of all data; no READ/WRITE - commands are 
included in IDEFIR. 


3.2 Subroutine IDEFIR 


The subroutine receives the design parameters DEL1...0MGS2 defining the tolerance scheme from the 
main program, and it delivers the resulting design parameters DEL1...OMGS1, coefficients, and addi- 
tional information to the calling program (for the single parameters and variables, see COMMENT sec- 
tion of the subroutine listing). The version given in the printout is prepared to handle filters of lengths 
nr < 256. A maximum of ITMAX = 20 design iterations is allowed. A p = 90% -tolerance usage is 
aimed at (PROZ = 0.9). Tolerance reductions are carried out by 75% of the tolerance violation value 
(CR = 0.75), increases by 25% of the unused space (CI = 0.25). Changes of p, Cp, C; are possible by 
replacing the corresponding three statements; however, it has to be considered that the choice of these 
values influences the convergence of the algorithm as well as the efficiency of the results: with Cp 
increased and p decreased, fewer iterations may be needed, but the resulting solution may have too 
large a length! On the other hand, larger values C, and p may provide a more efficient use of the toler- 
ances, but they might lead to a program "oscillation"! 


The steps of the subroutine IDEFIR corresponding to the block diagram (Fig. 1) are marked in the list- 
ing in a similar way by comments to be found easily. They are carried out by appropriate subroutines 
to be explained in the sequel. 


3.3 Subroutine TYPTRA 


This routine identifies the filter type from the tolerance scheme by assigning an appropriate value to the 
variable ITYP. Furthermore, it receives the original tolerance scheme from the calling subroutine IDE- 
FIR, and it delivers the tolerances for the equivalent lowpass problem. 


3.4 Subroutine WCMIN 

The minimum possible wordlength /W = Wenin is calculated from the prescribed tolerances D1 = 6), 
D2 = &,, and the transition bandwidth DOMG = AQ = 1 5— Q pof a lowpass. 

3.5 Subroutine LENGTH 


The filter length NF is calculated from the prescribed tolerances D1 = 5,, D2 = 8», and the transition 
bandwidth DOMG = AQ = 15 — 1 pof a lowpass. 


3.6 Subroutine EFFERR 


The approximate statistical error bound Sis calculated from the tolerance D = 6 of an exact-coefficient 
filter, the length NF = nz, and the coefficient wordlength /W = w, in an iterating loop. The actual 
error formula is evaluated by calling the subroutine SSTAT. 

3.7 Subroutine SSTAT 

The expected error SQ = S/Q (i.e., normalized to the quantization step-size Q = ae) is calculated 
from the filter length NF = n, and the ratio ALPHA = a = 8/S of original "ripple" size and rounding 
error. 


3.8. Subroutine DESIGN 


Here, any convenient linear-phase, direct-form, FIR lowpass design routine can be applied. Of course, 
the parameter lists in the routine DESIGN and in the CALL DESIGN statement in the subroutine 
IDEFIR have to be adapted. 


In the version given here, DESIGN receives the equivalent lowpass tolerances DEL11 = 8, 


DEL21 = a OMGP1 = 2,,, OMGS1 = ,), and the filter length NF = ng; it delivers to the calling 
routine IDEFIR the coefficient vector HO = h,(v), v € {0,1,....(m—1)}. 
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3.9 Subroutine MAXERR 


The maximum deviation EMAX = E,,,, of a linear-phase FIR lowpass from the corresponding ideal 
lowpass is calculated. The parameters used are the coefficient vector RHO= R[h,(v)], 
v € {0,1,...,(m;-1)}, the length N1 = n, of this vector, the filter length NF = n,, and the frequency 
range [OMGA,OMGE] = [9 4,9 ¢], for which the maximum error is wanted. 


The actual error calculation is carried out by calling the subroutine ERROR 
3.10 Subroutine ERROR 


The difference E between an ideal lowpass and a linear-phase FIR lowpass at the frequency point 
OMG = © is calculated from the N1 = n, coefficients RHO= R{[h,(v)], v € {0, (ny-1)} of a 
length NF = n, filter. The routine assumes that a fairly close approximation is given: E < 0.5 is 
necessary. 


3.11 Subroutine BACTRA 


According to the information ITYP on the desired filter type, delivered by SUBROUTINE TYPTRA 
(see part 3!), the exact and rounded coefficients, HO = h,(v), RHO= R[h,(v)], of the lowpass filter 
are transformed. The /owpass filter length NF = n, is received and the length NF = n; of the desired 
filter is delivered to the calling program. 


3.12 Subroutine WCACT 


The NI = mh rounded coefficients RHO= R[h,(v)], v € {0,1,...,(;-1)} are quantized to a stepsize 
o=2'". thus, with a sign bit, /WC = w, bits are used to completely define any rounded 
coefficients, in general. 


In special realizations, however, omitting leading zeros behind the binary point might decrease the filter 
wordlength. Therefore, the “actual wordlength" /WACT = w, - (minimum number of leading zeros in 
all coefficients) is determined. 


3.13 DIMENSION and COMMON Requirements 


The routines IDEFIR, DESIGN, MAXERR, ERROR, WCACT contain array specifications for the 
coefficient vectors HO = h,(v) or RHO= R{h,(v)] or both. In the state presented here, a maximum 
of n, = 128 different coefficients is allowed, meaning a maximum filter length of ny = 256. COMMON 
specifications are not contained. If, however, the subroutine DESIGN to be applied needs such 
definitions, they must be inserted into the main program and the subroutine IDEFIR as well. In this 
case, it has to be checked, whether any variables contained in the COMMON definition, are already 
used in subroutine parameter lists. 


4. Summary of User Requirements 


1. Write MAIN program with input/output commands, the subroutine call 

CALL IDEFIR (DEL1, DEL2, OMGP1, OMGS1, OMGP2, OMGS2, ITYP, NFOO, NF, IWCMIN, 
IWC, IWACT, DEL11, DEL21, EMAX1, EMAX2, HO, RHO, ITERA, IERR), 

and the proper DIMENSION and COMMON specifications according to those contained in IDEFIR, 

DESIGN, MAXERR, ERROR, WCACT. 


2. Adapt a convenient DESIGN routine to the subroutine IDEFIR requirements; especially, check 
the parameter lists, DIMENSION, and COMMON specifications. 
5. Test Program and Test Problems 


The routines described above were linked to a main program "IDEFIX" (see the listing below), meeting 
the requirements given in Section 3.1. As a possible design routine, a subroutine-package version of 
the PARKS-McCLELLAN program [6], capable of designing odd-length filters only, was applied. 


Five examples were computed by supplying to the computer the following five data cards: 


5.4-5 


FIR Programs Chapter 5 


DELI DEL2 OMGPIl OMGS1 OMGP2 OMGS2 


1) 0.01 0.001 0.3 0.35 0.0 0.0 
2) 0.01 0.001 0.2 0.15 0.0 0.0 
3) 0.01 0.001 0.175 0.15 0.325 0.35 
4) 0.01 0.001 0.12 0.15 0.38 0.35 
5) 0.005 0.005 0.025 0.0 0.0 0.0 


The resulting line printer outputs are given below in the tables for the five examples: 


- Lowpass 
- Highpass 
- Bandpass 
- Bandstop 
- HILBERT-Transform 
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Table 1 


ITERATIVE DESIGN OF LINEAR PHASE FIR FILTERS IN DIRECT FORM 
WITH MINIMUM COEFFICIENT WORDLENGTH 


LOWPASS WITH DELTA 1 = 0.010000,DELTA 2 = 0.001000 

OMEGA P = 0.300000,OMEGA S = 0.350000 
EST. MIN. WORDLENGTH WC MIN = 15 BITS (SIGN+BITS BEHIND THE DUAL POINT) 
ESTIMATED LOWPASS LENGTH NF = 55 


COEFFICIENT WORDLENGTH APPLIED we = 15 
ACTUAL WORDLENGTH WITHOUT LEADING ZEROS we ACT = 15 
ACTUAL FILTER LENGTH NF = 57 


REDUCED LOWPASS TOLERANCE SCHEME DELTA 1 PRIME = 0.008796 
DELTA 2 PRIME = 0.000593 
EXACT FILTER COEFFICIENTS HO (I), I = 0...((NF-1)/2) 


-0.001865 -0. 000806 0.003469 0.001039 
-0.002183 0.003388 0.001655 -0.004896 
0.003558 0.003980 -0.008106 0.002993 
0.008183 -0.011719 0.000822 0.014755 

-0.015467 -0.004170 0.024699 -0.018991 
-0.014353 0.040839 -0,021880 -0.037062 
0.075071 -0.023781 -0.122956 0.286443 
0.642227 
ROUNDED FILTER COEFFICIENTS HO (I) 

-0.001831 -0.000793 0.003418 0.001038 
-0.002136 0.003357 0.001648 -0.004883 
0.003540 0.003967 -0.008057 0.002991 
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Table 1 
(Continued) 

0.008179 -0.011719 0.000793 0.014709 
-0.015442 -0.004150 0.024658 -0.018982 
-0.014343 0.040833 -0.021851 -0.037048 

0.075012 -0.023743 -0.122925 0.286438 

0.642212 


ACTUAL TOLERANCES OF THE EQUIVALENT LOWPASS WITH ROUNDED COEFFICIENTS 
DELTA 1 = 0.008044,DELTA 2 = 0.000671 
NUMBER OF DESIGN ITERATIONS = 4 


Table 2 


ITERATIVE DESIGN OF LINEAR PHASE FIR FILTERS IN DIRECT FORM 
WITH MINIMUM COEFFICIENT WORDLENGTH 


HIGHPASS WITH DELTA 1 = 0.010000,DELTA 2 = 0.001000 
OMEGA P = 0.200000,OMEGA S = 0.150000 
EQUIVALENT LOWPASS WITH DELTA 1 = 0.010000,DELTA 2 = 0.001000 
OMEGA P = 0.300000,OMEGA S = 0.350000 
EST. MIN. WORDLENGTH WC MIN = 15 BITS (SIGN+BITS BEHIND THE DUAL POINT) 
ESTIMATED LOWPASS LENGTH NF = 55 


COEFFICIENT WORDLENGTH APPLIED we = 15 

ACTUAL WORDLENGTH WITHOUT LEADING ZEROS we ACT = 15 
ACTUAL FILTER LENGTH NF = 57 

REDUCED LOWPASS TOLERANCE SCHEME DELTA 1 PRIME = 0.008796 


DELTA 2 PRIME = 0.000593 
EXACT FILTER COEFFICIENTS HO (I), I = 0...((NF-1)/2) 


-0.001865 0.000806 0.003469 -0.001039 
-0.002183 -0.003388 0.001655 0.004896 
0.003558 ~0.003980 -0,.008106 -0.002993 
0.008183 0.011719 0.000822 0.014755 
-0.015467 0.004170 0.024699 0.018991 
0.014353 -0.040839 -0.021880 0.037062 
0.075071 0.023781 -0.122956 -0.286443 
0.642227 

ROUNDED FILTER COEFFICIENTS HO (I) 

-0.001831 0.000793 0.003418 -0.001038 
-0.002136 -0.003357 0.001648 0.004883 
0.003540 -0.003967 -0.008057 -0.002991 
0.008179 0.011719 0.000793 -0.014709 
-0.015442 0.004150 0.024658 0.018982 
-0.014343 0.040833 -0.021851 0.037048 
0.075012 0.023743 -0.122925 -0.286438 
0.642212 


ACTUAL TOLERANCES OF THE EQUIVALENT LOWPASS WITH ROUNDED COEFFICIENTS 
DELTA 1 = 0.008044,DELTA 2 = 0.000671 
NUMBER OF DESIGN ITERATIONS = 4 


Table 3 


ITERATIVE DESIGN OF LINEAR PHASE FIR FILTERS IN DIRECT FORM 
WITH MINIMUM COEFFICIENT WORDLENGTH 


BANDPASS WITH DELTA 1 = 0.010000,DELTA 2 = 0.001000 
OMEGAP1 = 0.175000,OMEGAS1 = 0.150000 
OMEGAP2 = 0.325000,OMEGAS2 = 0.350000 
EQUIVALENT LOWPASS WITH DELTA 1 = 0.010000,DELTA 2 = 0.001000 
OMEGA P = 0.150000,OMEGA S = 0.200000 
EST. MIN. WORDLENGTH WC MIN = 15 BITS (SIGN+BITS BEHIND THE DUAL POINT) 
ESTIMATED LOWPASS LENGTH NF = 55 


COEFFICIENT WORDLENGTH APPLIED we = 15 
ACTUAL WORDLENGTH WITHOUT LEADING ZEROS WC ACT = 14 
ACTUAL FILTER LENGTH NF = 117 


REDUCED LOWPASS TOLERANCE SCHEME DELTA 1 PRIME = 0.008362 
DELTA 2 PRIME = 0.000430 
EXACT FILTER COEFFICIENTS HO (I), I = 0...((NF-1)/2) 


0.000607 0. -0.000572 oO. 
-0.000520 oO. 0.002465 oO. 
-0.003505 Oo. 0.001855 0. 
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Table 3 
(Continued) 
0.001906 oO. -0.004329 
0.002120 oO. 0.003647 
-0.007141 Qo. 0.003230 
0.005906 oO. -0.010919 
0.004360 oO. 0.009573 
~0.016369 oO. 0.005519 
0.015509 0. -0.024539 
0.006580 0. 0.025888 
-0.038408 0. 0.007432 
0.047958 0. -0.070128 
0.007984 0. 0.132416 
-0.279054 oO. 0.341510 
ROUNDED FILTER COEFFICIENTS HO (I) 
0.000549 -0.000549 
-0.000488 0. 0.002441 
-0.003479 0. 0.001831 
0.001892 0. -0.004272 
0.002075 0. 0.003601 
-0.007141 Qo. 0.003174 
0.005859 0. -0.010864 
0.004333 Qo. 0.009521 
-0.016357 oO. 0.005493 
0.015503 oO. -0.024536 
0.006531 oO. 0.025879 
-0.038391 oO. 0.007385 
0.047913 0. -0.070068 
0.007935 0. 0.132385 
-0.279053 0. 0.341492 
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ACTUAL TOLERANCES OF THE EQUIVALENT LOWPASS WITH ROUNDED COEFFICIENTS 
DELTA 1 = 0.009576,DELTA 2 = 0.000987 
NUMBER OF DESIGN ITERATIONS = 12 


Table 4 


ITERATIVE DESIGN OF LINEAR PHASE FIR FILTERS IN DIRECT FORM 
WITH MINIMUM COEFFICIENT WORDLENGTH 


BANDSTOP WITH DELTA 1 = 0.010000,DELTA 2 
OMEGAP1 = 0.120000,OMEGAS1 
OMEGAP2 = 0.380000,0OMEGAS2 


0.001000 
0.150000 
0.350000 


EQUIVALENT LOWPASS WITH DELTA 1 = 0.010000,DELTA 2 = 0.001000 
OMEGA P = 0.240000,OMEGA S 
EST. MIN. WORDLENGTH WC MIN = 15 BITS (SIGN+BITS BEHIND THE DUAL POINT) 
ESTIMATED LOWPASS LENGTH NF = 47 


COEFFICIENT WORDLENGTH APPLIED 
ACTUAL WORDLENGTH WITHOUT LEADING ZEROS 
ACTUAL FILTER LENGTH 
REDUCED’ LOWPASS. TOLERANCE SCHEME 


NF = 93 


we = 15 


we ACT 


DELTA 1 PRIME 


DELTA 2 PRIME 
EXACT FILTER COEFFICIENTS HO (I), I = 0...((NF-1)/2 


-0.001520 0. -0,003752 
-0.000894 0. 0.003676 
0.000481 0. -0.005578 
0.000340 0. 0.008082 
-0.001983 0. -0.011180 
0.005010 0. 0.014701 
-0.010025 oO. -0.018449 
0.017968 0. 0.022139 
-0.030583 oO. -0.025456 
0.052231 oO. 0.028100 
-0.098901 oO. -0.029799 
0.315849 0. 0.530385 
ROUNDED FILTER COEFFICIENTS HO (I) 

-0.001465 oO. -0.003723 
-0.000854 o. 0.003662 
0.000427 Oo. -0.005554 
0.000305 oO. 0.008057 
-0.001953 0. -0.011169 
0.005005 0. 0.014648 
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oO. 


) 


0.300000 


15 


0.009881 
0.000676 
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-0.010010 
0.017944 
-0.030579 
0.052185 
-0.098877 
0.315796 


Table 4 
(Continued) 


-0.018433 
0.022095 
-0.025452 
0.028076 
-0.029785 
0.530334 


ACTUAL TOLERANCES OF THE EQUIVALENT LOWPASS WITH ROUNDED COEFFICIENTS 


DELTA 1 = 


0.009237,DELTA 2 
NUMBER OF DESIGN ITERATIONS 


= 0.000885 
= 1 


Table 5 


ITERATIVE DESIGN OF LINEAR PHASE FIR FILTERS IN DIRECT FORM 
WITH MINIMUM COEFFICIENT WORDLENGTH 


HILBERT-TRANSFORMER WITH DELTA = 0.005000,OMEGAP = 0.025000 
EQUIVALENT LOWPASS WITH DELTA 1 = 0.002500,DELTA 2 = 0.002500 


OMEGA P = 0.225000,OMEGA S = 0.275000 


EST. MIN. WORDLENGTH WC MIN = 14 BITS (SIGN+BITS BEHIND THE DUAL POINT) 
ESTIMATED LOWPASS LENGTH NF = 59 


COEFFICIENT WORDLENGTH APPLIED 


ACTUAL WORDLENGTH WITHOUT LEADING ZEROS 
ACTUAL FILTER LENGTH 


NF = 59 
REDUCED LOWPASS TOLERANCE SCHEME 


woe = 14 


we ACT = 14 


DELTA 1 PRIME = 0.002137 


DELTA 2 PRIME = 0.002137 
EXACT FILTER COEFFICIENTS HO (I), I = 0...((NF-1)/2) 


0.003471 
0.007564 
0.014415 
0.025550 
0.044355 
0.081828 
0.208221 


0.003418 
0.007324 
0.014404 
0.025391 
0.044189 
0.081787 
0.208008 


0.002960 0.000055 
0.005015 0.000055 
0.010351 0.000055 
0.019086 0.000055 
0.033402 0.000055 
0.059084 0.000055 
0.120482 0.000055 
0.635134 0. 
ROUNDED FILTER COEFFICIENTS HO (I) 
0.002930 0. 
0.004883 0. 
0.010254 0. 
0.019043 0. 
0.033203 oO. 
0.059082 0. 
0.120361 0. 
0.635010 0. 


0.000055 
0.000055 
0.000055 
0.000055 
0.000055 
0.000055 
0.000055 


ACTUAL TOLERANCES OF THE EQUIVALENT LOWPASS WITH ROUNDED COEFFICIENTS 
DELTA 1 = 0.002485,DELTA 2 = 0.002422 
NUMBER OF DESIGN ITERATIONS = 1 
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CHAPTER 6 


IIR Filter Design and Synthesis 


J. F. Kaiser and K. Steiglitz 


The problems of designing infinite impulse response (IIR) and finite impulse response (FIR) digital 
filters differ in a number of significant ways. First, in the important special cases of lowpass, highpass, 
and bandpass magnitude specifications, we have available in the IIR case the classical closed-form 
designs associated with the names of Butterworth (maximally-flat pass and stop bands), Chebyshev 
(equiripple pass or stop band), and Cauer (elliptic, equiripple pass and stop bands) originally developed 
for the continuous case. 


The first program in this chapter, DOREDI by G. F. Dehner, is devoted to the design, implementation, 
and analysis of finite wordlength IIR digital filters based on such closed form designs. This very 
comprehensive program includes the capability of designing the classic lowpass, highpass, bandpass, and 
bandstop filters from specifications on cutoff frequencies and passband and stopband tolerances. The 
program has the facility to determine from the extended degree infinite-precision coefficient design the 
minimum coefficient wordlength assuming coefficient rounding necessary to meet the filter 
specifications. There is also the facility to optimize the noise performance of the filter by changing the 
pairing and ordering of the poles and zeros of the filter being realized as a cascade of second-order sec- 
tions. These last two powerful features can also be used directly on filter designs input separately. Thus 
the Dehner program provides a very comprehensive IIR filter design capability. 


When the design of an IIR digital filter with arbitrary magnitude or phase characteristics is needed, we 
encounter another important difference between the IIR and FIR cases. The general IIR design problem 
is highly nonlinear in the filter coefficients, whereas the FIR problem is linear. This means that general 
purpose design programs are necessarily more complicated and time consuming than their FIR counter- 
parts. Two such programs are included here: LPIIR by A. Deczky, based on the minimum p-error cri- 
terion [1], and OPTIIR by M. T. Dolan and J. F. Kaiser, which uses the penalty function method. 
LPIIR minimizes the p'” power of the error, and so includes the least-square-error case (when p=2) 
and the minimax criterion (when p—ce). Typically p=40 is sufficient for the minimax criterion. LPIIR 
also provides an option for phase equalization. 


Two different general purpose IIR design programs are included here because these optimization prob- 
lems can be quite difficult numerically. Any one given program may fail to converge on some problem, 
especially one of high order. Also, we have no mathematical guarantee that the solutions obtained are 
globally optimal, since the convergence criterion is usually that the gradient of the error be very small 
in norm - a necessary but not sufficient condition for global optimality in general nonlinear design prob- 
lems. The reader may therefore wish to try a given problem on both programs, and compare the solu- 
tions if they both converge within the allotted execution time. Even in the cases where convergence is 
obtained and the specifications are satisfied, different computers may give different results. These 
differences can be attributed to different computer word lengths, different rounding rules, different 
conversion routines, and different FORTRAN compilers. 


The last program, FWIIR by K. Steiglitz and B. D. Ladendorf, deals with the problem of choosing finite 
word-length coefficients in a cascade implementation of an IIR filter. The program requires the user to 
provide an "infinite-precision" design in this form. This problem is doubly difficult, since it is not only 
nonlinear in its parameters, but its parameter space is discrete. No algorithm is known which is practical 
for problems with as many as 12-16 parameters and which also guarantees optimality, so it is necessary 
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to use a heuristic. FWIIR uses a randomized version of the Hooke-and-Jeeves search algorithm [2,3], 
which attempts to build a pattern of successful moves on the grid in parameter space. The fact that it is 
randomized means that different runs may produce different local optima; the user can then select, the 
best. 


FWIIR yields results which are very close to those reported by Avenhaus and Schuessler [4], who also 
use a search on a discrete grid. Recently Brglez [5] presented a method which improves on some pub- 
lished examples by 1 or 2 bits. He does a sequence of discrete local optimizations interspersed with con- 
tinuous optimizations, thus allowing excursions in parameter space larger than would be obtained by 
search on a discrete grid only. Brglez’s paper appeared too late for inclusion of his program here. The 
reader is also referred to related work on the IIR problem [6,7,8] and the FIR problem [9,10]. 
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Program for the Design of Recursive Digital Filters 


G. F. Dehner 


Institut fiir Nachrichtentechnik 
Univ. Erlangen-Niirnberg, Cauerstrasse 7 
D-8520 Erlangen, Germany 


1. Purpose and Method 


The general purpose program, DOREDI, an acronym for Design and Optimization of REcursive Digital 
filters, is designed to solve the classic approximation problem for recursive digital filters, to minimize 
the coefficient wordlength and then to minimize the noise performance by scaling and pairing and ord- 
ering the poles and zeros for a number of different structures, and finally to analyze the performance of 
the resulting filter. 


A general view of the design possibilities of DOREDI is given in the block diagram in Fig. 1. 


The analysis and noise optimization procedures not only can be applied to filters generated within the 
design program, but also can be used for the investigation of other filter designs by inputting separately 
their filter coefficients. 


1.1 Design of selective IIR-filters 


The filter types that can be handled are the lowpass, highpass, symmetrical bandpass and bandstop 
filters. The types of approximation available are the maximally-flat magnitude (Butterworth), the Che- 
byshev types I and II, and the elliptic (Cauer) forms. The method used is the transformation of the 
tolerance scheme into the continuous domain, the approximation, and then the transformation back to 
the discrete domain [1], [2]. 


1.2 Optimization of the coefficient wordlength 


The optimization is obtained by choosing an appropriate filter degree and, thus, a certain margin inside 
the given tolerance scheme (necessary extension of the filter degree, see [3],[4]). This margin, unused 
for filters with a high coefficient wordlength, is distributed between passband and stopband such that 
the required wordlength of the rounded coefficients is small (trial and error procedure) [3], [4]. 


1.3 Optimization of the state variable wordlength 


For cascade structures with given second-order blocks, the output noise and consequently the 
wordlength of the state variables [1] is optimized by pairing poles and zeros and ordering the subsys- 
tems; a heuristic method is used called "optimization with limited storage" and is described in [4]. For 
a system of lower order, this procedure is equivalent to the "dynamic programming" approach [5] and 
leads to an exact solution for systems including independent white noise sources, only. 


In order to reduce storage and computing time only the S,,,, best intermediate results are stored and 
handled in the consecutive step. For S,,,, = 1, the procedure equals the "direct procedure" explained in 
[4] and [6]. For general noise sources (see Appendix B) the optimization procedure considers the 
correlations within the second-order blocks, only. 


1.4 Analysis of the optimized filter 


Input: Coefficients designed by the program or specified independently with input data cards (class 
01, 03, 04, and 05, see sect. 2.2). 
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(a) 
(b) 


(c) 


Input: 
tolerance scheme 

approximation method 
structure of the second order blocks! 


Optimization of the wordlength of the state variables (and coefficients) 


Optimization of the coefficient wordlength 


Design with unrounded 
coefficients 


filter degree 


change of 

the design 

parameter 
c 


second order blocks 


Optimization 
of the word. 


ordering already 
optimized 


Optimization of the 
ordering 

min. wordlength of the 

state variables 


separate 
scaling factors 


Output: Optimized coefficients, 
required additional wordlength Aw 
Analysis of the designed filter 


Fig. 1 Block diagram of DOREDI 


Test of the necessary coefficient wordlength. 


1.5 Realization of the transfer function 


In the cascade realization, the transfer function is given by 


baz? + byzt 
H(z) =] 27 1azZ + bon 


ant 2? + CZ + Coy 
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Calculations of the output noise and the additional wordlength of the state variables; all correla- 
tions of the noise sources within the total filter are taken into account. 


Printer plots of the magnitude and the phase of the frequency response as well as the impulse 
response. 


() 


Section 6.1 EQUR 


The coefficient and state variable wordlengths can be optimized for different hardware realizations. 
1.5.1 Coefficients 
The options available are: 


(a) fixed-point sign-magnitude realization 
(b)  "pseudo"-floating-point realization 
(c) realization by differences 


For a detailed description of the different realizations see Appendix A and [4]. 
1.5.2 State Variables 


Fixed-point two’s complement representation: The necessary reduction of the wordlength inside the 
filter can be done by different arithmetics and at different points within the filter structures. For a 
detailed description see Appendix B and [4], [6], [7], [8]. 


1.5.3 Structures of Second-Order Blocks 


The structures available are variations of the first and second canonic forms (Fig. 2) with or without 
separate scaling factors. 


First Form Second Form 


Fig. 2. Signal-flow graph of the canonic forms. 


Scaling can be realized by a multiplication with an arbitrary value or by a power of two [4], [6], [10]. 


2. How to Use DOREDI - Description of the Input Data 


The whole design and optimization program is controlled by the main program calling the on-line input 
data compiler and the proper program sections sequentially for the different tasks. All input data are 
read in via the on-line input compiler, allowing an almost free ordering of the data cards within one 
program section. 


2.1 Call of the program sections and the input compiler 

Normal program section card format 

"//" marks the program section card. "name" means the program section 
name; only the first two characters are significant. A program section is 


/ /name closed by another program section card or by a finish card with the charac- 
ter string: //FInish. 


, a UE eae} 


Program section format without DECODE 


Normally the input data card is processed by the "DECODE" statement. If "DECODE" does not con- 
form to the compiler in use, an alternative program section input can be installed by compilation (see 
sect. 4.1). The original program section card is split up into a special contro! card "//" and a second 
card with the program section name beginning in column 3. 

4 2 3, 4, A. 32.03 la 


ane name 
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Description of the program sections 


//SYnthesis: Design of recursive digital filters with or without optimized coefficients 

//SEquence: Optimization of the pairing and ordering of second-order blocks achieving 
minimum output noise 

//S8S (Synthesis-Sequence) 


This task includes the sections //SY and //SE. For a realization of second- 
order blocks without separate scaling factor, another optimization of the 
coefficient wordlength is done in a third step taking into account the sequence 
of the second-order blocks fixed in the step before (Fig. 1). 


//ANalysis: Analysis of the digital filter designed before or defined by input data cards. 


2.2 Control parameters and filter data input 
Normal input formats 


Two formats are used for the input of the design parameters (tolerance scheme, program control 
parameters, filter realization, etc.): 


(a) The first one is the control card with a unified format for one LOGICAL, one INTEGER and 
three REAL parameters: 


FORMAT(1A1,212,2X,L1,1X,15,1X,3E15.0,12A1) 
12345 8 10-14 16-30, s1-45 46-60, 


ee oe ee 


*]1JJ L INTEG REAL 


In the following, the different input variables are described by a short notation: 
*I1JJ L.INTEG,REAL,REAL,REAL,;COMMENT 


If any data arrays within one set of data are superfluous, they are marked by "bb"; following 
superfluous arrays are not marked. 


Description of the data arrays 


“IJ: Input code 
II, Input class 
JJ, Number within a class 
Input cards to be used alternatively belong to the same decade (e.g., 
JJ=41 or JJ=42). 


E. LOGICAL input 
FORMAT: LI T = TRUE 
F, any other character, or blank = FALSE 
INTEG INTEGER input 
FORMAT: IS, right-justified 
REAL REAL input 


FORMAT: unformatted floating-point read statement within the specified array, 
if necessary with a right-justified exponent x.xxE+ee 


(b) For the input of INTEGER arrays (e.g., a predetermined pairing and ordering, or the exponents 
of the "pseudo"-floating point coefficients) a second type of format, the INTEGER data card, is 
necessary. This data card can only be used as a continuation card of a control card. 


FORMAT (1A1,212,3X,1614) 
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The coefficient and state variable wordlengths can be optimized for different hardware realizations. 
1.5.1 Coefficients 
The options available are: 


(a) fixed-point sign-magnitude realization 
(b) "pseudo"-floating-point realization 
(c) realization by differences 


For a detailed description of the different realizations see Appendix A and [4]. 
1.5.2 State Variables 


Fixed-point two’s complement representation: The necessary reduction of the wordlength inside the 
filter can be done by different arithmetics and at different points within the filter structures, For a 
detailed description see Appendix B and [4], [6], [7], [8]. 


1.5.3 Structures of Second-Order Blocks 


The structures available are variations of the first and second canonic forms (Fig. 2) with or without 
separate scaling factors. 


First Form Second Form 


Fig. 2 Signal-flow graph of the canonic forms. 


Scaling can be realized by a multiplication with an arbitrary value or by a power of two [4], [6], [10]. 


2. How to Use DOREDI - Description of the Input Data 


The whole design and optimization program is controlled by the main program calling the on-line input 
data compiler and the proper program sections sequentially for the different tasks. All input data are 
read in via the on-line input compiler, allowing an almost free ordering of the data cards within one 
program section. 


2.1 Call of the program sections and the input compiler 

Normal program section card format 

"//" marks the program section card. "name" means the program section 
name; only the first two characters are significant. A program section is 


/ /name closed by another program section card or by a finish card with the charac- 
ter string: //FInish. 


4 2 3 4 


Program section format without DECODE 


Normally the input data card is processed by the "DECODE" statement. If "DECODE" does not con- 
form to the compiler in use, an alternative program section input can be installed by compilation (see 
sect. 4.1). The original program section card is split up into a special control card "//" and a second 
card with the program section name beginning in column 3. 
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Description of the program sections 
//SYnthesis: Design of recursive digital filters with or without optimized coefficients 


//SEquence: Optimization of the pairing and ordering of second-order blocks achieving 
minimum output noise 


1/88 (Synthesis-Sequence) 
This task includes the sections //SY and //SE. For a realization of second- 
order blocks without separate scaling factor, another optimization of the 
coefficient wordlength is done in a third step taking into account the sequence 
of the second-order blocks fixed in the step before (Fig. 1). 


//ANalysis: Analysis of the digital filter designed before or defined by input data cards, 


2.2 Control parameters and filter data input 
Normal input formats 


Two formats are used for the input of the design parameters (tolerance scheme, program control 
parameters, filter realization, etc.): 


(a) The first one is the control card with a unified format for one LOGICAL, one INTEGER and 
three REAL parameters: 


FORMAT(1A1,212,2X,L1,1X,15,1X,3E15.0,12A1) 
12345 8 10-14 16-30, 31-85 46-60 


) Mita eo a 


REAL, REAL 


*11JJ L INTEG REAL+ +. 


In the following, the different input variables are described by a short notation: 
*I1JJ L.INTEG,REAL,REAL,REAL,;COMMENT 


If any data arrays within one set of data are superfluous, they are marked by "bb"; following 
superfluous arrays are not marked. 


Description of the data arrays 


“IS: Input code 
Il, Input class 
JJ, Number within a class 
Input cards to be used alternatively belong to the same decade (e.g., 
JJ=41 or JJ=42). 


L LOGICAL input 
FORMAT: LI T = TRUE 
F, any other character, or blank = FALSE 
INTEG INTEGER input 
FORMAT: I5, right-justified 
REAL REAL input 


FORMAT: unformatted floating-point read statement within the specified array, 
if necessary with a right-justified exponent x.xxE+ee 


(b) For the input of INTEGER arrays (e.g., a predetermined pairing and ordering, or the exponents 
of the "pseudo"-floating point coefficients) a second type of format, the INTEGER data card, is 
necessary. This data card can only be used as a continuation card of a control card. 


FORMAT (1A1,212,3X,1614) 
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9- 13- A7- 61- 65- 
5 emt emer Pee, P| 42 16 


20 64 68 


INno2 IN02 INO3 IN15 IN46 
Description of the data arrays 
*00JJ Input code for the INTEGER data card. II has to be 00 because this format is 


only used for data input following a control card. JJ Number of the leading 
control card 


INO1..IN16 | INTEGER-array 
FORMAT: 1614, right-justified 


Input formats without "DECODE" 
: Le See nae 
a aa According to sect. 2.1 a second data input format can be installed. 
awe ee For this purpose, all data cards are split up into a control card "*" and 
% a second card with input code and data in the normal input format. 


Description of the input parameters 


In the following, the different input data are explained. They are classified according 
to their functions: 


Class 00 - data input (only used in connection with a control card) 
Class 01 - general input/output control 

Class 02 - parameters for the optimizations 

Class 03 - tolerance scheme 

Class 04 - realization of the coefficients 

Class 05 - realization of the blocks of second order 

Class 06 - special analysis of the designed filter. 


The use of some of the input data classes makes no sense, if called in an individual program 
section. Therefore, Table 1 shows (x) the principally allowed input data classes for the 
different program sections. 


As far as it is useful, default values are assigned to the input parameters; in addition to the 
definition of the tolerance scheme, the input is reduced to those data (or data cards, respec- 
tively) disagreeing with the default values. 


At the beginning of the program all parameters agree with their default values. When a new 
program section within a program run is reopened, only the parameters within the input data 
classes, marked by "d" in Table 1, are redefined by their default values. 
[CLASS | SY | SE ss_ | AN | 
01 x x x x 


02 Me ded 

03 x » Salaial a 3 

04 x x x d|x 

05 x dix dame 

06 1 | 


Table 1 Allowed input data classes (x) and redefinition of the default values (d). 
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2.2.1 General Input/Output Control — Data Cards of Class 01 
2.2.1.1 Input of filter coefficients (for the program sections SE and AN) 


*0110 bb, NINP 
NINP Input parameter 


NINP=1; Unrounded coefficients and, if not explicitly specified by input data, the realiza- 
tion parameters from the previous program section 


NINP=2: See NINP=1, but from a disk file (channel number KA4) 


NINP=3: Input of second-order blocks from the card reader; the following data cards are 
expected to immediately follow the control card+): 
*0010 bb,NB,FACT 
*0010 bb,bb,B2(01),B1(01),BO(01) 


*0010 bb,bb,B2(NB),BI(NB),BO(NB) 
*0010 bb,bb,bb,C1(01),C0(01) 
*0010 bb,bb,bb,C1 (NB),CO(NB) 


NINP=4: Input of the zeros and poles; the following data cards are expected immediately 
behind the control card +): 
*0010 bb, NB,FACT 
*0010 bb,bb,ZZR(01),ZZ1(01) 


*0010 bb,bb,ZZR (NB) ,ZZI(NB) 
*0010 bb,bb,ZPR(01),ZPI(01) 


*0010 bb,bb,ZPR (NB),ZPI(NB) 
only the zeros and poles in the closed upper complex plane have to be declared, 
Default value: NINP=1 
2.2.1.2 Output of the results on the line printer 


*0120 bb, NOUT 

NOUT INTEGER parameter for the output on the line printer (channel number KA2) 
NOUT=0: No line printer output 

to 

NOUT=S: Complete line printer output with all intermediate results 
For the intermediate results, see output example in section 3. 

Default value: NOUT=3 

2.2.1.3 Output of the results on the disk 


*0130 LDOUT 

LDOUT LOGICAL parameter for the output on the disk (channel number KA4) 
True: An output is provided according to the ASCII format given below 
False: No disk output 


+ For the meaning of the names see section 2.2.1.3, 


Section 6.1 


Default value: LDOUT=.FALSE. 
List of formatted records for the output on the disk 


» === DOREDI === VERSION V005 ===" 


"FILTER DESCRIPTION’ 
ITYP,[APRO,NDEG 
SF,OM()),...,OM(4),ADELP,ADELS 
AC,ROM(),...,ROM(4), RDELP,RDELS 
NZM(1),....NZM(4),M 
ZM(1,1),...,ZM(1,4) 


ZM(M, 1),...,ZM(M,4) 


FACT 


B2(1),B1(1),BO(1),C1(1),CO(1) 


B2(NB),B1 (NB),BO(NB),C1(NB),CO(NB) 
IRCO(1),...,.IRCO(S) 
IECO(1,1),...,.IECO(1,5) 


IECO(NB,1),...,IECO(NB,5) 
IDCO(1,1),...,.IDCO(1,5) 


IDCO(NB, 1),....,IDCO(NB,5) 
IWL,IECOM,JMAXV,ITRB2 
"END OF DATA’ 


All INTEGER records in the format 1015 
All REAL records in the format 4E15.7 


Description of the parameters 


ITYP 
IAPRO 
NDEG 
SF 
OM(I) 
ADELP 
ADELS 
AC 
ROM(I) 
RDELP 
RDELS 
NZM(I) 
M 
ZM(I,1) 
ZM(1,2) 


= filter type 
= kind of approximation 


filter degree 

= sampling frequency 

= cutoff frequencies 2 in radians 
= ripple in the passband (s) 

= ripple in the stopband(s) 

= design parameter C 

= changed cutoff frequencies 

= changed ripple in the passband(s) 
= changed ripple in the stopband(s) 
= number of the different extrema 
max {NZM(J)}; J = 1,2,3,4 


location of the maxima in the passband 


= location of the minima in the passband 
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2.2.1.4 


ZM(I,3) = location of the maxima in the stopband 
ZM(1,4) = location of the zeros in the stopband 
NB = number of blocks of second order 
FACT = gain factor 


B2(1),B1(1),BO(1) = numerator coefficients 
C1(1),CO(I) == denominator coefficients 


ZZR(I) = real part of the zeros in the z-plane 
ZZ\(1) = imaginary part of the zeros in the z-plane (ZZI(I) =0, real zero) 
ZPR(I) = real part of the poles in the z-plane 
ZPI(1) = imaginary part of the poles in the z-plane (ZPI(I) =0, real pole) 


IRCO(N),IFCO(L,N),IDCO(L,N),IWL,IECOM,JMAXV and JTRB2 are described in sect. 
2.2.4. 


Special output 
*0140 LSPOUT,ISPOUT 
LSPOUT LOGICAL parameter for the special output 
True: Output is provided; a special output procedure "OUTSPE" has to be defined and 
linked to the program by the user (see sect. 4). 
False: No special output 
ISPOUT: Free parameter for the special output 
Default values: LSPOUT=.FALSE. 
ISPOUT=0 


2.2.2 Parameters for the Optimization — Data Cards of Class 02 


2.2.2.1 


Optimization of the coefficient wordlength 
*0210 LWLF,ITERM,ACX,ACXMI,ACXMA 
LWLF LOGICAL parameter for the optimization of the tolerance scheme utilization 
with a fixed wordlength 
True: Optimization of the parameters ACX for a fixed coefficient wordlength IWL; 
IWL can be defined by the control card *0410 (see sect. 2.2.4.1) 
False: No fixed wordlength; coefficient wordlength will be minimized 
ITERM Maximum number of optimization cycles for the final coefficient optimization 
ACX See section 2.2.3.2 (for the alternative input format see section 4.1) 
ACXMI Lower bound for the design parameter ACX: 0. < ACXMI < 1. 
ACXMA Upper bound of the design parameter ACX: 0. < ACXMA < 1. 
Default values: LWLF=.FALSE. 
ITERM=10 
ACX, see *0320 in section 2.2.3.2 and Appendix D 
ACXMI=0. 
ACXMA=1. 
*0220 bb, ITERM1 
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ITERM1 


Default value: 


EQUR 


Maximum number of optimization cycles for the pre-optimization (see sect. 
2.1, //SS) 


ITERM1=4 


2.2.2.2 Optimization of the output noise 


*0230 


LPAIRF 
True: 


False: 
ISTOR 


Default values: 


*0240 
LSEQ 


True: 


False: 
ISCAL 
ISCAL=1: 


ISCAL=2: 


ISCAL=3: 


SCALM 


Default values: 


LPAIRF,ISTOR 


The program section call //SE or //SS starts the output noise optimization 
automatically. This control card is only necessary to alter the default values. 


LOGICAL parameter for a fixed pairing 


Optimization of the ordering of blocks of second order with a fixed pairing of 
the poles and zeros, according to a rule of thumb [1], [4], [6], or to the input 
by the control card *0240. For structures 21, 23, 25, and 27 the input *0240 
provides fixed pairing of the auxiliary blocks (Appendix C). ATTENTION: 
fixed pairing is not possible for the structures 22, 24, 26, and 28. 


Free optimization of the pairing and ordering 


Maximum number of intermediate storage S,,,, for the "optimization with lim- 
ited storage" [4], ISTOR < 100 


LPAIRF=.FALSE. 
ISTOR=100 


LSEQ,ISCAL,SCALM 


LOGICAL parameter for the input of a fixed pairing and ordering (e.g., as a 
start ordering for the heuristic optimization) 


Input of a fixed pairing of the zeros and poles. Two input data cards have to 
follow immediately: 

*0040 maces INTEGER data format 

*0040 ISEQD()),...,ISEQD(16), 

The numerator and denominator are numbered in an ascending order. 
ISEQN(I) =J means the J-th numerator out of the input sequence is taken as 
the I-th numerator in the final realization. The same is true for the denomina- 
tor declaration ISEQD(I). 


No input 

INTEGER parameter for the kind of scaling [1], [4] 
absolute criterion 

¥ |o(k)| < SCALM + 

k=O 


criterion for sinusoid input 
L. = max|F,(Q)| < SCALM ¢ + 


criterion for the power of a white noise source 
13-1 f In(aPao <scatm+ 
0 


Tv 
chosen maximum of the overflow points 


LSEQ=.FALSE. 
ISCAL=2 
SCALM=1. 


+ The criterion has to be satisfied for all overflow points within the realized structure. 


+ 


L, = Lz norm; L.. = L... norm; F, see Appendix B. 
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2.2.3 Description of the Desired Filter — Data Cards of Class 03 
2.2.3.1 Type of the filter; sampling frequency 
*0310 bb, ITYP,SF 
ITYP Filter type 
ITYP=1: lowpass filter 
ITYP=2: highpass filter 
ITYP=3: symmetrical bandpass filter 
ITYP=4: symmetrical bandstop filter 


SF Sampling frequency (input may as well be executed with the data cards *0341 
or *0342) 


Default values: ITYP=1 
SF no default value provided 


2.2.3.2 Type of approximation; design parameter 


*0320 bb, IAPRO,ACX 

IAPRO Type of approximation 
IAPRO=1: Butterworth (maximally flat) 
IAPRO=2: Chebyshev I (passband) 
IAPRO=3: Chebyshev II (stopband) 
IAPRO=4: Elliptic filter (Cauer) 


ACX Normalized design parameter C for the utilization of the tolerances in the 
passband and the stopband (3],{4] (start value for the optimization) 
0.<ACX< 1. (See Appendix D) 


ACX=0.; _ the passband tolerance is used completely 
to 
ACX=1.; | the stopband tolerance is used completely 


Default values: IAPRO=4 (elliptic filter) 
ACX, such that passband and stopband are used as equally as possible. (For 
the alternative input format see section 4.1; in this case for the default input, 
ACX has to be set to ACX=1000.) 


2.2.3.3 Filter degree (order of the recursive system) 


*0330 LDEGF,NDEG,EDEG 
LDEGF LOGICAL parameter related to the specification of a filter degree. For the 
check of the filter order, the degree extension [4] is introduced into the calcula- 
tion. 
True: If the tolerance scheme cannot be fulfilled with the prescribed degree, the pro- 
gram run is terminated. 
False: If the given degree is not sufficient, the order is increased automatically. 
NDEG Prescribed filter order 
EDEG Relative extension of the degree [4]. 


Default values: LDEGF=.FALSE. 
NDEG see remarks 
EDEG=0.2 (for the alternative input format see section 4.1) 
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Remarks: 


a) Normally, the degree is determined automatically. The minimum degree 
"min found in this way is not necessarily an integer value. Taking this 
into account as well as including the degree extension for the purpose of a 
minimized coefficient expenditure [3], [4], yields the order to be used as 


An 
[tmin(1 + ——lop) J rounded 
Amin 
n= MA 
<M min> half—adjusted 


An lope = EDEG 


min 
b) maximum filter degree is set to m4, = 32 


c) To obtain the minimum filter degree for a prescribed tolerance scheme, 
the degree extension EDEG has to be set explicitly to EDEG=0.0. 


2.2.3.4 Cutoff frequencies for the passband(s) and stopband(s) 
The cutoff frequencies are read in by one (and only one) of the following sets of data: 


fs, fry fea fs, fay 
0 My Noy Np, Nsz Tt —- —2 
O  Ysy Ypy Vp2 Vsz ) = v 
Fig. 3. Cutoff frequencies (e.g., for a bandpass). 
(a) *0341 bb,bb, FR(1),FR(2),<SF> 
and for bandpass and bandstop filters in addition 
*0342 bb, bb, FR (3),FR(4),<SF> 
FR(D Unnormalized cutoff frequencies 
lowpass | highpass | bandpass | bandstop 
FR(1) tp Ss fs Sri 
FR(2) Fs Sp Sei fs 
FR(3) Sr2 Ss2 
FR(4) Lf Spr 
SF Sampling frequency; superfluous, if already defined in data card *0310. The 


units of FR(I) and SF have to be identical - i.e., both Hz or kHz. (<> means 
that this parameter may be omitted.) 


(b) *0343 bb,bb,OM(1),0M(2) 
and additionally for bandpass or bandstop filters 
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(c) 


(a) 


+0344 
omM() 
+0345 


*0346 
s@ 


*0347 
VSN 


VD 
A 


Remarks: 


Chapter 6 


bb,bb,OM (3),0M (4) 

Cutoff frequencies in radians, normalized by the sampling frequency 
bb, bb,S(1),S(2) 

and additionally for bandpass and bandstop 

bb,bb,S(3),S(4) 


Cutoff frequencies of the corresponding analog system (input if analog filters 
are to be designed) 


bb,bb, VSN,VD,A 


Normalized stopband cutoff frequency v,’ of the corresponding analog lowpass 
filter (actual design parameter for the transition from passband to stopband [1]) 


Passband edge frequency of the corresponding analog lowpass filter, VD = vp 


Parameter for the transformations from the normalized lowpass to the bandpass 
and bandstop filters. 


a) Prescription of only three cutoff frequencies for symmetrical band filters. 
If four frequency values are prescribed, the requirements for the calcula- 
tion of the reference lowpass are overdetermined. Without further data 
input, the tolerance scheme is utilized such that a minimal filter degree is 
achieved (see section 2.2.3.6). If only three frequency values are given, 
the fourth one is automatically chosen in a manner yielding an analog 
band filter which is symmetric with respect to its center frequency. Exam- 
ple: 


0 sy Yp Ys2 
Ves Vez 
Fig. 4. Free choice of the cutoff frequency Vp2 for a symmetric bandpass. 
b) Determination of the transition band. The filter order and the tolerances 
6p and 5s being given, the transition bandwidth of the filter can be deter- 


mined automatically. A required degree extension for the optimization of 
the coefficient wordlength is taken into account. Lowpass example: 


at Sas | 
1 
n=6 ' n=6 ! 
H ' 
' 
1 es 
ee eee 


Fig. 5. Free choice of one cutoff frequency for a lowpass. 


For a band filter, remark a) can be regarded in addition; then, only two 
cutoff frequencies have to be prescribed. Bandpass example: 
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: f n=10 

i 

| 1! | n=10 1] | n=10 

11 4 ig ome 
a Se 


Fig. 6. Free choice of two cutoff frequencies for a bandpass. 
2.2.3.5 Tolerances in passband and stopband 
The passband and stopband tolerances are read in by one of the following data cards, optionally: 
(a) *0351 bb,bb, ADELP,ADELS 


ADELP Tolerance 6» in the passband 
ADELS Tolerance 55 in the stopband 
(b) *0352 bb,bb, AP,AS 
AP Tolerated passband attenuation ap (in dB) 
AS Stopband attenuation as (in dB) 
(c) *0353 bb,bb,P,AS 
P Reflection coefficient p 
P=p=/1- (1-8p) 
Remarks: The filter order, the transition band, and one of the 8 tolerances being given, 


the other one can be determined. A required degree extension for the optimi- 
zation of the coefficient wordlength can also be regarded. Examples are given 
in Fig. 7. 


Lowpass Highpass 


Bandpass 


Fig. 7. Free choice of one of the tolerances. 


2.2.3.6 ‘Choice’ of the symmetrical band filter 


*0360 bb, NORMA 
NORMA Parameter for the determination of the reference lowpass of symmetrical 
bandfilters 
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NORMA=0: calculation of vp such that 7,,\, is minimized; 


NORMA=!: calculation of vp from the inner cutoff frequencies; 


NORMA =2: calculation of vp from the outer cutoff frequencies, 


NORMA=3: calculation of vp as the geometric mean of all cutoff frequencies. Examples 
for a bandpass filter are shown in Fig. 8. 


Default value: NORMA=0 


z= 


— 
Ys3 Yp2 Ys1 to) Yp2 
Vs2 Vp Vso 
NORMA = 1; vp = \/¥pi¥p2 NORMA = 2; vp = V/¥s\¥52 
VSN = 1.18 VSN = 1.12 


here, this is equivalent to NORMA = 0 


Fig. 8. Different choice of the parameter NORMA 
2.2.3.7 Output of the analog filter 


*0370 LSOUT 

LSOUT LOGICAL parameter for the special output 
True: Output of poles, zeros, and 2nd order blocks of the corresponding analog filter 
False: No special output 


Default value: LSOUT=.FALSE. 
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2.2.4 Realization of the Coefficients — Data Cards of Class 04 


General coefficient representation (see Appendix A) 
ACO(L,N) =ACOS(L,N)*2.**(IRCO(N) — IECO(L,N)) 


—SIGN(2.**IDCO(L,N),ACOS(L,N)) 


Description of the parameters 


2.2.4.1 


2.2.4.2 


ACO(L,1) = B2(L) = 53, 
ACO(L,2) = BI(L) = 6, 
ACO(L,3) = BO(L) = bo, 
ACO(L,4) = C1(L) = ¢1, 
ACO(L,5) = CO(L) = co, 


ACOS(L,N) = sign + mantissa of the "pseudo"-floating-point coefficients 
IRCO(N) = exponent of the number range 


IECO(L,N) = 


"pseudo"-floating-point exponent 


IDCO(L,N) = exponent of the difference branch 


Coefficient wordlength 


*0410 
LSTAB 


True: 


False: 


IWL 


Default value: 


Attention: 


LSTAB,IWL 
LOGICAL parameter for the stability test 


Check only whether the system with rounded coefficients is stable; no correc- 
tion. 


Check whether the system with rounded coefficients is stable and change, if 
necessary. 


Wordlength of sign and mantissa; quantization Q, = 2~ Wt"! 
IWLMI < IWL < IWLMA,; for IWLMI and IWLMA see sect. 4. 


LSTAB=.FALSE. 
IWL = 16 


IWL is only used for the optimization of the coefficient errors. For other 
inputs apply IWLR in *0530. 


Number range of the coefficients 


*0420 
RCOINP 


True: 


False: 
JRCO 
JRCO<0 
JRCO>0 
JRCO|=1 
JRCO|=2 


RCOINP,JRCO 


LOGICAL parameter for the input of a predetermined array of coefficient 
ranges 


One additional INTEGER-data card is necessary: 
*0020 IRCO(1),...,IRCO(S) 


No extra input. 

Parameter for the calculation of the necessary coefficient ranges 
ranges IRCO(I) <0 allowed 

ranges IRCO(I) >0 only 

separate ranges for B2(L),B1(L),BO(L),C1(L),CO(L) 


one common range for (B2(L),B1(L),BO(L)); separate range for C1(L) and for 
CO(L) 


6.1-15 


IIR Programs Chapter 6 


IRCO|=3 one common range each for (B2(L),B1(L),BO(L)) and for (C1(L),CO(L)) 
RCO|=4 common ranges for (B1(L),C1(L)) and (BO(L),CO(L)) 
RCO|=5 one common range for all coefficients 

Default values: RCOINP=.FALSE. 


JRCO=2 
2.2.4.3 ’Pseudo’-floating-point coefficients 
*0430 ECOINP,JECO 
ECOINP LOGICAL parameter for the input of predetermined exponents 
True: Five additional INTEGER-data cards are necessary: 


*0030 IECO(1,1),...,.IECO(NB, 1) 
*0030 IECO(1,5),...,IECO(NB,5) 
NB = number of second-order blocks used 
False: No extra input 
JECO Parameter for the calculation of the exponents 
JECO=0 no "pseudo"-floating-point realization 
JECO~0 value of the "pseudo”-floating-point exponent must be less or equal to JECO 
Default values: ECOINP=.FALSE. 


JECO=0 
2.2.4.4 Realization by differences 
*0440 DCOINP,JDCO 
DCOINP LOGICAL parameter for the input of predetermined difference branches 
True: Five additional INTEGER-data cards are necessary: 


+0040 IDCO(1,1 


.-.IDCO(NB, 1) 


+0040 IDCO(1,5),....,.IDCO(NB,5) 
NB = number of second-order blocks used 
IDCO(L,N) = —100 means no difference branch for this coefficient 


False; No extra input 
JDCO Parameter for the calculation of the difference branches 
JDCO=0: no realization with differences 


JDCO#0: realization with differences is possible. JDCO is used as a code word; the digits 
are assigned to the control parameters JJDCO(N) of the different coefficient 


classes: 
JDCO = JDCO(5) for CO(L) 
JJDCO(4) for C1(L) 
JJDCO(3) for BO(L) 
JJDCO(2) for B1(L) 
JJDCO(1) for B2(L) 
JJDCO(N) =1: common difference branch realization for all blocks 
(block multiplexing) 
JJDCO(N) =2: separate realization, only for those blocks with 


coefficients less than half the original number range 
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Default values: DCOINP=.FALSE 
JDCO=00000 


2.2.4.5 Realization of the largest numbers within the range 


*0450 bb, JMAXV 

JMAXV Parameter for the control of the largest numbers 
JMAXV=1: UR ¢x <2" 
JMAXV=2: 28 x < 2k two’s complement 
JMAXV=-2:  —2"® < x < 2'* and 2'* + 2'*-LSB representation 
JMAXV=3: wR <x <2 sign-magnitude 
JMAXV=-3 -2'® < x < 2'® and —2® — —2'*+LSB ? representation 


2’ — 2'8-LSB 
LSB = Least significant bit 


Remark: JMAXV=—2,—3 is useful to reduce the necessary number range 

Default values: JMAXV=—3 

*0460 bb, JTRB2 

JTRB2 Parameter to control the rounding of the scaling factors; correction of the scal- 
ing error 


JTRB2<0: normal rounding of the coefficients with an influence on scaling; violation of 
the scaling is possible 


JTRB2>0: truncation of these coefficients 
UTRB2|=1 only the total gain factor FACT is corrected 


ITRB2|=2 the scaling of the next block is corrected (useful for structures with separate 
scaling factors (see sect. 2.2.5.1)) 


TRB2|=3: in addition to JTRB2=2, the coefficients B1(L) and BO(L) of the same block 
are corrected (useful for structures without separate scaling factors) 
Default values: JTRB2=3 
2.2.5 Realization of the Cascade Structures with Blocks of Second Order — Data Cards of Class 05 


The implemented structures for second-order blocks with five or four (zeros on the unit circle) 
coefficients are shown in Figs. 9 and 10. The nonlinearities are marked by a square box with an N over 
it. The characteristics of these nonlinearities are declared by a control card. For scaling, because of the 
two’s complement realization of the state variables, only the overflow points marked by — have to be 
checked. 


2.2.5.1 Structures of second-order blocks 


*0510 LPOT2,ISTRU 

LPOT2 LOGICAL parameter for the choice of the scaling factor 
True: Scaling by powers of two (bit shifts) 
False: Scaling with any factor 


6.1-17 


IIR Programs Chapter 6 


STRUCTURE 17 STRUCTURE 18 


Fig. 9. Blocks of second order in the first canonic form. 
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STRUCTURE 27 STRUCTURE 28 


Fig. 10 Blocks of second order in the second canonic form. The coefficient 4; is only 
realized in the first block of a cascade; for the calculation of the noise, the 
part, separated by L..-_ is attached to the following block; 6; = b,/b3. 


* only realized for the last block in the cascade 
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ISTRU 


Default value: 


Chapter 6 
Number of the structure of the second-order blocks to be realized (see catalog 
in Figs. 9 and 10). 


LPOT2=.FALSE. 
ISTRU=13 


2.2.5.2 Characteristics of the nonlinearities 


*0520 
CNOINP 


True: 


False: 
JCNO 


Default value: 


*0530 
LCNO 


True: 
False: 
IWLR 


Default value: 


CNOINP,JCNO 


LOGICAL parameter for the input of inhomogeneous nonlinearity characteris- 
tics for the different second-order blocks 


Five additional input data cards are necessary to characterize the nonlinearities 
*0020 ICNO(1,1),...,.ICNO(NB, 1) 


+0020 ICNO(1,5),...,ICNO(NB,5) 
NB = number of second-order blocks 


ICNO(L,N) = control parameter according to JICNO (see next section); in 
this case JCNO is unaffected 


No extra input 


parameter for the input of the nonlinearity characteristics, unified for all blocks 
JCNO is used as a code word; the digits are assigned to the five nonlinearities, 
according to JICNO 


JCNO = 


Zeros are replaced by the values of the nearest succeeding nonzero digit; e€.g., 
00205 = 22255. The different characteristics are described by the parameter 
JJCNO (see Appendix B). 


JJCNO=1: two’s complement rounding 

JJCNO=2: sign magnitude rounding 

JJCNO=3: mathematical rounding 

JJCNO=4: two’s complement truncation 

JJCNO=5: unsymmetrical sign magnitude truncation 
JJCNO=6: symmetrical sign magnitude truncation 
JJCNO=7: random rounding 


Especially for small coefficients, these different characteristics are distinct in 
their generation of random noise, DC offset, and errors correlated with the sig- 
nal [4]. For the error values see Appendix B. 


CNOINP=.FALSE. 
JCNO=33333 


LCNO,IWLR 


LOGICAL parameter for the consideration of the coefficient quantization by 
the calculation of the output noise (see Appendix B). 


No coefficient quantization is considered 
Noise parameters will be adjusted (see Appendix B, Table B-1). 


parameter for the specification of the realized coefficient wordlength. In the 
noise analysis, the wordlength may be different from that found by the 
coefficient optimization. 


LCNO=.FALSE. 
IWLR=100, (no coefficient rounding) or result of the coefficients optimization 
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2.2.6 Analysis of the Designed Filter — Data Cards of Class 06 
2.2.6.1 Coefficient analysis 


*0610 
LWLM 


True: 


False: 
IWL 
Default value: 


2.2.6.2 Noise analysis 


LWLM,IWL 
LOGICAL parameter for the search of minimum wordlength 


For a given set of coefficients and realization the necessary coefficient 
wordlength will be found. 


Error analysis is done for a fixed wordlength IWL. 
Coefficient wordlength 


LWLM=.FALSE. 
IWL=16 


For a given realization, the output noise and the necessary additional wordlength Aw are calcu- 


lated. 
*0620 


LSEQ,ISCAL,SCALM 


For description of the parameters see control card *0240, sect. 2.2.2.2. In addi- 
tion if ISCAL=—1 no scaling is done. 


2.2.6.3 Printer plot of the magnitude of the frequency response 


*0630 


LNOR 

True: 

False: 
IPAG 
OMLO 
OMUP 
RMAX 
Default values: 


LNOR,IPAG,OMLO,OMUP,RMAX 


Response in linear scale 

LOGICAL parameter for the normalization 

Normalization to the extreme values in the given range 

No normalization 

Number of line printer pages to be used for one plot 

Lower limit for the abscissa (normalized frequency in radians) 
Upper limit for the abscissa (normalized frequency in radians) 
Maximum value for the ordinate 


LNOR=.FALSE. (range from 0. to RMAX) 

IPAG=2 

OMLO=0. (for the alternative input format see sect. 4.1) 
OMUP=7 

RMAX=1. 


2.2.6.4 Printer plot of the attenuation of the frequency response 


*0640 


Default values: 


LNOR,IPAG,OMLO,OMUP,RMAX 
Response in dB, for parameter description see sect. 2.2.6.3. 


LNOR=.FALSE. (range from 0. to RMAX) 
IPAG=2 
OMLO=0. 
OMUP=7 
RMAX=100 dB 


; (for the alternative input format see sect. 4.1) 


2.2.6.5 Printer plot of the phase response 


*0650 


LNOR,IPAG,OMLO,OMUP 
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For parameter description see sect. 2.2.6.3. 


Default values: LNOR=.FALSE. (range from —7z to +7) 
IPAG=2 


.; (for the alternative input format see sect. 4.1) 


2.2.6.6 Printer plot of the impulse response 


*0660 LNOR,IPAG,RMIN,RMAX 
LNOR Parameter for the normalization, see sect. 2.2.6.3. 
IPAG Number of line printer pages 
RMIN Minimum value for the ordinate of the unnormalized plot range 
RMAX Maximum value for the ordinate of the unnormalized plot range 
Default values: LNOR=.FALSE. (range from RMIN to RMAX) 

IPAG=2 

RMIN=-1. 

RMAX=1. 


3. Examples for the Filter Design and Optimization 
3.1 Design of a filter without optimization 
3.1.1 Specifications 


Lowpass: 
sampling frequency SJ 4 = 20.0 kHz 
cutoff frequency in the passband fp = 2.0 kHz 
cutoff frequency in the stopband fs = 4.0 kHz 
passband tolerance 5p = 0.02 
stopband tolerance 6; = 0.001 
3.1.2 Execution of the Design 


extension of the filter degree a 


min 


= 0.2 


equal use of passband and stopband 
3.1.3 Input Data Cards 


//SY 

#0310 20. 

#0341 2. 4. 
#0351 0.02 0.001 
//FI 


3.1.4 Output on the Line Printer 
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3.1.4.1 Normal output, according to the default output code NOUT = 3 


=== VERSION V005 = 


DATA INPUT 

4/8SY 

* a 10 0 0.200000E 02 Oo. 0. 
* 3°41 0 0.200000E 01 0.400000E 01 oO. 
* 3 51 i) 0.200000E-01 0.100000E-02 0. 
/7¥L 


TOLERANCE SCHEME 


FILTER-TYPE 


LOWPASS 
APPROXIMATION 

ELLIPTIC 
SAMPLING FREQ. 20.000000 
CUTOFF FREQUENCIES 2.000000 4.000000 
NORM. CUTOFF FREQ. 0.628319 1.256637 
CUTOFF FREQ. S-DOM. 0.324920 0.726543 
PASSBAND RIPPLE(S) 0.020000 0.1755 DB Pe 0.1990 
STOPBAND RIPPLE(S) 0.001000 60.0000 DB 
MIN. FILTER DEGREE 4.6285 
DEGREE EXTENSION 0.9257 
CHOSEN FILTER DEG. 6 


BOUND PAIR OF THE DESIGN PARAMETER C 3.2927 .LE. C .LE. 61.6686 


REALIZED 
NORM. CUTOFF FREQ. 0.628319 1.256637 
CHOSEN DESIGN PAR. CX = 0.6632134 (=) C= 22.9879777 


UTILIZATION OF THE PASSBAND DELTA P = 0.0028525 = 14.26252 PERCENT 
STOPBAND DELTA S = 0.0001432 = 14.32376 PERCENT 


POLES AND ZEROS IN THE Z-DOMAIN 


CONSTANT GAIN FACTOR = 0.1559554E-02 


2 0.717153 +-J* 0.590872 0.280642 +-J« 0.959812 
2 0.675963 +-J* 0.412069 0.000000 +-J«+ 1.000000 
2 


NUM. POLES NUM. ZEROS 
2 
2 
0.666428 +-J* 0.150211 2 -0.753474 +-J* 0.657478 


BLOCKS OF SECOND ORDER 


CONSTANT GAIN FACTOR = 0.1559554E-02 
L B2(L) B1(L) BO(L) c1(L) co(L) 
1 1.00000000 -0.56128475 1.00000000 -1.43430551 0.86343788 
2 1.00000000 -0.00000001 1.00000000 -1.35192616 0.62672679 
3 1.00000000 1.50694796 1.00000000 -1.33285540 0.46668934 


6.1-23 


IIR Programs Chapter 6 


3.1.4.2 Complete line printer output, according to the greatest output, code NOUT = 5 
NOUT 


= VERSION v005 


DATA INPUT 
4/8Y 
* 4 20 5 0. oO. 0. 
* a: 40 Oo 0.200000E 02 Oo. 0. 
* 30441 0 0.200000E 01 0.400000E 01 0. 
* 2s 34 0 0.200000E-01 0.100000E-02 oO. 
4/¥I 
TOLERANCE SCHEME 
23 

FILTER-TYPE 

LOWPASS 
APPROXIMATION 

ELLIPTIC 
SAMPLING FREQ. 20.000000 
CUTOFF FREQUENCIES 2.000000 4.000000 
NORM. CUTOFF FREQ. 0.628319 1.256637 
CUTOFF FREQ. S-DOM. 0.324920 0.726543 
PASSBAND RIPPLE(S) 0.020000 0.1755 DB Pe 0.1990 
STOPBAND RIPPLE(S) 0.001000 60.0000 DB 
NORMALIZED PARAMETER IN THE S-DOMAIN 2 4 
vD = 0.324920 
VSN = 2.236068 
MIN. FILTER DEGREE 4.6285 > 3 
DEGREE EXTENSION 0.9257 
CHOSEN FILTER DEG. 6 
CAP. DELTA 0.003293 


ZEROS OF THE CHARACTERISTIC FUNCTION /K(J*#V)/##2 
2 0.969399 +-J« 0. 
2 0.726543 +-J+ oO. 
2 0.272422 +-J* 0. 


BOUND PAIR OF THE DESIGN PARAMETER C 3.2927 .LE. C .LE. 61.6686 


Se 


POLES AND ZEROS OF THE NORMALIZED REFERENCE LOWPASS IN THE S-DOMAIN 


=5 
NUM. POLES NUM. ZEROS 
2 Oo. +-J* 2.306654 
2 oO. +-J* 3.077684 
2 Oo. +-J* 8.208093 
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POLES AND ZEROS OF THE REFERENCE FILTER IN THE S-DOMAIN 


NUM. POLES NUM. ZEROS 
2 oO. +-J* 0.749477 
2 oO. +-J* 1.000000 
2 oO. +-J* 2.666971 
REALIZED 
NORM. CUTOFF FREQ. 0.628319 1.256637 
CHOSEN DESIGN PAR. CX = 0.6632134 (=) C= 22.9879777 


UTILIZATION OF THE PASSBAND DELTA P = 0.0028525 = 14.26252 PERCENT 
STOPBAND DELTA S = 0.0001432 = 14.32376 PERCENT 


POLES AND ZEROS OF THE NORMALIZED REFERENCE LOWPASS IN THE S-DOMAIN 


CONSTANT GAIN FACTOR = 0.1432376E-03 
NUM. POLES NUM. ZEROS 
2 -0.127449 +-J« 1.102886 
2 -0.385683 +-J* 0.851538 
2 0.586296 +-J* 0.330270 


POLES AND ZEROS OF THE REFERENCE FILTER IN THE S-DOMAIN 


CONSTANT GAIN FACTOR = 0.1432376E-03 


NUM. POLES NUM. ZEROS 
2 -0.041411 +-Je 0.358349 2 0. +-J* 0.749477 
2 0.125316 +-J* 0.276681 2 0. +-Je 1.000000 
2 -0.190499 +-J« 0.107311 2 0. +-Je 2.666971 
POLES AND ZEROS IN THE Z-DOMAIN 
CONSTANT GAIN FACTOR = 0.1559554E-02 
NUM. POLES NUM. ZEROS 
2 0.717153 +-J« 0.590872 2 0.280642 +-J« 0.959812 
2 0.675963 +-J* 0.412069 2 0.000000 +-J+ 1.000000 
2 0.666428 +-J+ 0.150211 2 0.753474 +-J+ 0.657478 


BLOCKS OF SECOND ORDER 


CONSTANT GAIN FACTOR = 0.1559554E-02 
L B2(L) B1(L) BO(L) c1(L) cO(L) 
1 1.00000000 -0.56128475 1.00000000 -1.43430551 0.86343788 
2 1.00000000 -0.00000001 1.00000000 -1.35192616 0.62672679 
3 1,.00000000 1.50694796 1.00000000 -1.33285540 0.46668934 
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EXTREMES OF THE MAGNITUDE OF THE TRANSFER FUNCTION (COEFS NOT ROUNDED) 


MAXIMA IN THE PASSBAND (P) 
MAXIMA IN THE STOPBAND (S) 


BAND S-DOMAIN 


P 0.0885 
s 0.7265 
tg 0.2361 
s 0.8277 
P 0.3150 
Ss 1.3948 
S0.4254E 38 


Z-DOMAIN 
IN RAD IN DEGREE 
0.1766 10.1168 
1.2566 72.0000 
0.4636 26.5651 
1.3828 79.2305 
0.6103 34.9664 


1.8975 108.7215 
3.1416 180.0000 


MINIMA IN THE PASSBAND (P) 
MINIMA IN THE STOPBAND (S) 


BAND S-DOMAIN 


0. 

0.7495 
0.1693 
1.0000 
0.2852 
2.6670 
0.3249 


mnwnI HD 


Z-DOMAIN 

IN RAD IN DEGREE 
0. 0. 

1.2863 73.7015 
0.3353 19.2128 
1.5708 90.0000 
0.5557 31.8366 
2.4241 138.8922 
0.6283 36.0000 


3.2 Optimized design of a lowpass filter 
3.2.1 Specifications (see sect. 3.1.1) 


3.2.2 Chosen Realization 


MAGNITUDE 


1.000000 
0.000143 
1.000000 
0.000143 
1.000000 
0.000143 
0.000143 


MAGNITUDE 
0.997147 
0.997147 
0.000000 
0.997147 


0. 
0.997147 


Chapter 6 


Structure 16; first canonic form with separate scaling factors; mathematical rounding after each multi- 
plier; scaling by powers of two. 


3.2.3 Necessary Input Cards 


4/88 

#0210 20 
#0230 T 

#0310 

#0341 

#0351 

#0420 1 
#0450 1 
#0510 T 16 
//FI 


4. 
0.02 0.001 


3.2.4 Line Printer Output of the Designed Filter 


DATA INPUT 
4/SS 
* 


UP PWWWNHN 
wo 


Nt he eee 


“FI 


DOREDI 


=== VERSION vO00S 


0 0.200000E 00 
0 . 

) 0.200000E 02 
ti) 0.200000E 01 
0 0.200000E-01 
1 oO. 

1 

6 


o. 
0. 


oO. 
Oo. 
oO. 


0.400000E 01 
0.100000E-02 


oO. 


0. 
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TOLERANCE SCHEME 


FILTER-TYPE 


LOWPASS 
APPROXIMATION 

ELLIPTIC 
SAMPLING FREQ. 20.000000 
CUTOFF FREQUENCIES 2.000000 4.000000 
NORM. CUTOFF FREQ. 0.628319 1.256637 
CUTOFF FREQ. S-DOM. 0.324920 0.726543 
PASSBAND RIPPLE(S) 0.020000 0.1755 DB Pes 0.1990 
STOPBAND RIPPLE(S) 0.001000 60.0000 DB 
MIN. FILTER DEGREE 4.6285 
DEGREE EXTENSION 0.9257 
CHOSEN FILTER DEG. 6 


BOUND PAIR OF THE DESIGN PARAMETER C 3.2927 .LE. C .LE. 61.6686 


REALIZED 
NORM. CUTOFF FREQ. 0.628319 1.256637 


OPTIMIZATION IS TERMINATED AFTER THE 10. STEP 
THREE UNSUCCESSFUL STEPS 


CHOSEN DESIGN PAR. CX = 0.0031250 (=) C= 3.3230284 


UTILIZATION OF THE PASSBAND DELTA P = 0.0000599 = 0.29930 PERCENT 
STOPBAND DELTA S = 0.0009909 = 99.08854 PERCENT 


POLES AND ZEROS IN THE Z-DOMAIN 


CONSTANT GAIN FACTOR = 0.6750014E-02 


0.532684 +-J* 0.440233 0.000000 +-J+ 1.000000 


. POLES NUM. ZEROS 
2 
2 
2 -0.753474 +-J+ 0.657478 


iM 
2 0.621103 +-J« 0.646824 0.280642 +-J« 0.959812 
2 
2 


0.481727 +-J« 0.159623 


BLOCKS OF SECOND ORDER 


CONSTANT GAIN FACTOR = 0.6750014E-02 


L B2(L) B1(L) BO(L) c1(L) co(L) 

A 1.00000000 -0.56128475 1.00000000 -1.24220650 0.80415063 
2 1.00000000 -0.00000001 1.00000000 -1.06536840 0.47755731 
3 1.00000000 1.50694796 1.00000000 -0.96345360 0.25754030 
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EXTREMES OF THE MAGNITUDE OF THE TRANSFER FUNCTION (COEFS NOT ROUNDED) 


MAXIMA IN THE PASSBAND (P) 
MAXIMA IN THE STOPBAND (S) 


BAND S-DOMAIN Z-DOMAIN MAGNITUDE 
IN RAD IN DEGREE 
P 0.0885 0.1766 10.1168 1.000000 
s 0.7265 1.2566 72.0000 0.000991 
P 0.2361 0.4636 26.5651 1.000000 
s 0.8277 1.3828 79.2305 0.000991 
P 0.3150 0.6103 34,9664 1.000000 
s 1.3948 1.8975 108.7215 0.000991 
S0.4254E 38 3.1416 180.0000 0.000991 


MINIMA IN THE PASSBAND (P) 
MINIMA IN THE STOPBAND (S) 


BAND S-DOMAIN Z-DOMAIN MAGNITUDE 
IN RAD IN DEGREE 

P 0. 0. 0. 0.999940 
s 0.7495 1.2863 73.7015 0. 

P 0.1693 0.3353 19.2128 0.999940 
s 1.0000 1.5708 90.0000 0.000000 
P 0.2852 0.5557 31.8366 0.999940 
s 2.6670 2.4241 138.8922 0. 

P 0.3249 0.6283 36.0000 0.999940 


LAYOUT OF THE ROUNDED COEFFICIENTS 


WORDLENGTH 8 
COEF COEFS IR IE ID OCTAL 

B2( 1) 1.00000000= 1.00000000+2 O- 0) 2**-100 000000000000 
B2( 2) 1.00000000= 1.00000000e2**( O - 0) 2**-100 000000000000 
B2( 3) 1.00000000= 1.00000000e2**e( 0 - 0) 2¢*-100 000000000000 
B1( 1) -0.56250000= -0.28125000+2++( - 0) -2**-100 156000000000 
B1( 2) oO. = 0. 2 tory 0) 2**-100 100000000000 
B1( 3) 1.50000000= 0.75000000e2e+¢( 1 - 0) 2¢*-100 060000000000 
BO( 1) 1.00000000= 1.00000000*2**( O - 0) 2**-100 000000000000 
BO( 2) 1.00000000= 1.00000000e2««( O- 0) 2«*-100 000000000000 
BO( 3) 1.00000000= 1.00000000*2**( O- 0) 2**-100 000000000000 
c1( 1) -1.25000000= -0.62500000e2**#( 1 - 0) -2*«-100 130000000000 
c1( 2) -1.0625000, -0.53125000*2e«( 1 - 0) -2**-100 136000000000 
c1( 3) -0.96875000= -0.48437500*2**( 1 - 0) -2e*-100 141000000000 
co( 1) 0.80468750= 0.80468750«2*«( 0 - 0) 2**-100 063400000000 
co( 2) 0.47656250= 0.47656250*2**( 0 - 0) 2**-100 036400000000 
co( 3) 0.25781250= 0.25781250*2*e( O- 0) 2**-100 020400000000 


SEARCH OF MINIMUM WORDLENGTH 


IWL EPS-P EPS-S PMAX 
8 0.289635 0.979014 1.023068 


BLOCKS OF SECOND ORDER 


CONSTANT GAIN FACTOR = 0.6750014E-02 


L B2(L) B1(L) BO(L) c1(L) co(L) 

1 1.00000000 -0.56250000 1.00000000 -1.25000000 0.80468750 
2 1.00000000 0. 1.00000000 -1.06250000 0.47656250 
3 1.00000000 1.50000000 1.00000000 -0.96875000 0.25781250 


OPTIMIZATION OF THE PAIRING AND ORDERING 
STORAGE FOR THE INTERMEDIATE RESULTS ISTOR = 100 


FIXED PAIRING YES 
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REALIZED STRUCTURE 


SCALING OPTION 


BY A FACTOR OF POWER TWO 


CHOSEN MAXIMUM OF THE 


OVERFLOW POINTS 


REALIZATION OF THE COEFFICIENTS 


CONSIDERATION OF THE QUANTIZATION 


ISTRU = 16 


ISCAL 2 


YES 


SCALM = 1.000 


YES 
IWLR = 8 


(FOR IWLR=100 NO ROUNDING) 


WORDLENGTH 
NUM DEN SCALING 
2 2 0.125000 
3 3 0.125000 
1 1 0.250000 


TOTAL NOISE 


ABSOLUTE OUTPUT NOISE 
SCALING AT THE OUTPUT 
RELATIVE OUTPUT NOISE 
RELATED TO MAX /H/ = 1 
INNER NOISE FIGURE 

RELATED TO MAX /H/ = 1 
ENTRANCE NOISE FIGURE 
RELATED TO MAX /H/ = 1 


ADDITIONAL WORDLENGTH 


UNCOR. NOISE 


0.28031E 02 


0.65466E 02 


0.64145E 02 


0.15764E 03 


ANP 


SCA 


RIN 


REN 


COR. NOISE 


0. 


Oo. 


DELTA W = / 


DC-OFFSE' 


0.46048E 01 (Q#Q) 


0.59205E 00 
0.13137E 02 


(Q*Q) 


0.15764E 03 (Q*Q)/12 = 


0.25892E 00 


3.484/ = 4 


STRUCTURE WITH SEPARATE SCALING FACTORS B2(L) 


FOR STRUCTURES 21 TO 28 B2(0) 


BLOCKS OF SECOND ORDER 


CONSTANT GAIN FACTOR = 


L B2(L) B1(L) 

1 0.12500000 0. 

2 0.12500000 1.50000000 
3 0.25000000 -0.56250000 


GAIN FACTOR 


0.1000000E 01 


BO(L) c1(L) 
1.00000000 -1.06250000 
1,00000000 -0.96875000 
1.00000000 -1.25000000 


=) 


T Cl CO-QUAN 
BIT 
BIT 
BIT 
BIT 
BIT 


sROOW 


BIT 
BIT 
BIT 
BIT 
BIT 


sucswu 


BIT 
BIT 
BIT 
BIT 
BIT 


wwouw wwouw wwoow F 


yroen 


= 0.1576E 03 


= 6.63 DB 


» 11.18 DB 


21.98 DB 


co(L) 
0.47656250 
0.25781250 
0.80468750 


EQUR 


(CHA chosen characteristic for the nonlinearities N1...NS. 


@ _ CO-QUAN actual wordlength reduction in the nonlinearities N1...NS; this number of bits to be cut off is determined by the 
minimum actual coefficient quantization step size. 
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3.3 Optimized design of a bandpass filter 


The following examples illustrate some further possibilities of DOREDI. First, the input for the optim- 
ization of a bandpass filter is given. 


3.3.1 Specification of the Tolerance Scheme 


*0310 Bandpass 

*0330 Order n=10 

*0343 Normalized passband cutoff frequencies, Q p, = 7/10; 2 p, = 277/10 
*0344 The normalized stopband cutoff 


frequencies are chosen automatically, 
taking into account the default 
degree extension of 0.2; 


*0352 Tolerated passband attenuation ap = 0.2 dB 
Minimum stop band attenuation as =40dB 
3.3.2 Chosen Realization 
*0420 For all the coefficients one common range for the fixed point representation is 


chosen, according to the greatest magnitude of the actual coefficients. 


"0240 Pairing and ordering of the numerators and denominators of the second-order 
blocks will be done by dynamic programming. To avoid small overflows, 
evoked by the rounding error of the state variables, the chosen maximum of 
the scaling is set to SCALM=0.99. 


“0510 The output noise will be optimized for the second canonic form with only one 
nonlinearity after the summation (structure 23). 


*0520 To avoid limit cycles, random rounding is used within the recursive loop 
(JJCNO=7). Only at the end of the cascade two’s complement rounding is 
assigned (JJCNO=1) 


3.3.3 Analysis of the Designed Filter 


*0630 After the optimization of the described filter a printer plot of the magnitude 
*0640 and the attenuation will show the behavior of the frequency response for the 
coefficient set with final wordlength. 


3.3.4 Necessary Input Data Cards 


4/88 

*0240 0.99 

#0310 3 

#0330 10 

#0343 0.31416 
#0344 0.62832 

#0352 0.2 40. 
#0420 5 

#0510 23 

#0520 107 

//AN 
#0630 
*0640 
//¥I 


BA 


3.3.5 Line Printer Output of the Designed Filter 
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DOREDI 


VERSION v005 


DATA INPUT 
4/88 
* 2 40 oO 0.990000E 00 oO. oO. 
* 3 10 3 0. oO. oO. 
* 3 30 10 o. 0. 0. 
* 3 43 i) 0. 0.314160E 00 oO. 
* 3 (44 tt) 0.628320E 00 0. 0. 
* 3 «52 O 0.200000E 00 0.400000E 02 0. 
* 4 20 5 0. 0. 0. 
* Ss 10 23 0. 0. 0. 
* 5 20 107 0. 0. 0. 
/7BN 
TOLERANCE SCHEME 
FILTER-TYPE 

BANDPASS ‘ 
APPROXIMATION 

ELLIPTIC 
NORM. CUTOFF FREQ. Oo. 0.314160 0.628320 oO. 
CUTOFF FREQ. S-DOM. QO. 0.158385 0.324921 0. 
PASSBAND RIPPLE(S) 0.022763 0.2000 DB Pe 0.2121 
STOPBAND RIPPLE(S) 0.010000 40.0000 DB 


FILTER DBGREE ASSIGNED TO ORDER 10 


MIN. FILTER DEGREE 4.1667 
DEGREE EXTENSION 0.8333 
CHOSEN FILTER DEG. 5 


FOR THE REFERENCE LOWPASS 
ACTUAL FILTER DEGREE 10 


BOUND PAIR OF THE DESIGN PARAMETER C 2.1967 .LE. C «LE. 9.8821 
REALIZED 
NORM. CUTOFF FREQ. 0.251463 0.314160 0.628320 0.773302 


OPTIMIZATION IS TERMINATED AFTER THE 4. STEP 
MAXIMUM NUMBER OF STEPS 


BLOCKS OF SECOND ORDER 


CONSTANT GAIN FACTOR = 0.8861927E-02 
L B2(L) B1(L) BO(L) c1(L) co(L) 
a 1.00000000 -1.41015625 1.00000000 -1.52148437 0.93359375 
2 1.00000000 -1.09375000 1.00000000 -1.46679687 0.78515625 
3 1.00000000 0. -1.00000000 -1.57226563 0.74218750 
4 1.00000000 -1.96484375 1.00000000 -1.77539063 0.87500000 
5 1.00000000 -1.93945313 1.00000000 -1.88085937 0.96679687 


OPTIMIZATION OF THE PAIRING AND ORDERING 


STORAGE FOR THE INTERMEDIATE RESULTS ISTOR = 100 
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FIXED PAIRING 

REALIZED STRUCTURE 

SCALING OPTION 
BY A FACTOR OF POWER TWO 
CHOSEN MAXIMUM OF THE 
OVERFLOW POINTS 


REALIZATION OF THE COEFFICIENTS 


CONSIDERATION OF THE QUANTIZATION 


WORDLENGTH 


NO 
ISTRU = 23 
ISCAL = 2 

NO 
SCALM = 0.990 

YES 
IWLR = 11 


(FOR IWLR=100 NO ROUNDING) 


NUM DEN SCALING UNCOR. NOISE COR. NOISE 

1 3 0.103516 0.43090E 02 0. 

2 1 0.558594 0.60455E 02 0. 

5 2 0.250000 0.32107E 02 O. 

4 5 0.550781 0.51710E 03 0. 

3 4 0.679688 0.16365E 03 0. 

0 0 1.583008 0.10204E 01 0. 
TOTAL NOISE 0.81743E 03 0. 
ABSOLUTE OUTPUT NOISE ANP 0.66756E 02 
SCALING AT THE OUTPUT SCA 0.98994E 00 
RELATIVE OUTPUT NOISE RNP 0.68119E 02 
RELATED TO MAX /H/ = 1 
INNER NOISE FIGURE RIN 0.81743E 03 
RELATED TO MAX /H/ = 1 
ENTRANCE NOISE FIGURE REN 0.11543E 00 
RELATED TO MAX /H/ = 1 
ADDITIONAL WORDLENGTH DELTA W = / 4.759/ = 
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DC-OFFSET CHA CO-QUAN 


BIT 
BIT 
BIT 
BIT 
BIT 


excco 
ewocco 


BIT 
BIT 
BIT 
BIT 
BIT 


©0000 29000 cf2000 owc00 ooc00 


BIT 
BIT 
BIT 
BIT 
BIT 


BIT 
BIT 
BIT 
BIT 
BIT 


©1000 CNCDO CNC0O 


BIT 
BIT 
BIT 
BIT 
BIT 


exc0C° 


0.49324E-03 


BIT 
BIT 
BIT 
BIT 
BIT 


coco. 


0.49324E-03 


0.24329E-06= 0.8174E 03 


(Q*Q) = 18.24 DB 


(Q*Q) » 18.33 DB 


(Q#Q)/12 = 29.12 DB 


5 
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AnWHUVHANH UH 


BLOCKS OF SECOND ORDER 


CONSTANT GAIN FACTOR = 


L B2(L) 

1 0.55859375 
2 0.25000000 
) 0.55078125 
4 0.67968750 
5 1.58300781 


OPTIMIZATION IS TERMINATED AFTER THE 


B1i(L) 


0.1035156E 00 
BO(L) 


-0.78770447 0.55859375 
-0.27343750 0.25000000 


-1,06821 


442 0.55078125 


-1.33547974 0.67968750 


QO. 


THREE UNSUCCESSFUL STEPS 


CHOSEN DESIGN PAR. 


UTILIZATION OF THE PASSBAND DELTA P = 0. 
STOPBAND DELTA S 


-1.58300781 


CX = 0.0617819 (=) 


POLES AND ZEROS IN THE Z-DOMAIN 


CONSTANT GAIN FACTOR = 


NNNNNE 


POLES 


0.760564 +-J« 
0.731746 +-J« 
0.784508 +-J* 
0.887864 +-J* 
0.940917 +-J« 


BLOCKS OF SECOND ORDER 


CONSTANT GAIN FACTOR = 


B2(L) 
+00000000 
~00000000 
+00000000 
1.00000000 
1.00000000 


veunse 


EXTREMES OF THE MAGNITUDE OF THE TRANSFER FUNCTION (COEFS NOT ROUNDED) 


B1(L) 
-1.40973 


0.9106737E-02 


NUM. 
0.594928 2 
0.498722 2 
0.351874 1 
0.292069 1 
0.286555 2 
2 


0.9106737E-02 


BO(L) 
199 1.00000000 


-1.09325187 1.00000000 


oO. 


-1.00000000 


-1.96418508 1.00000000 


1.93972 


760 1.00000000 


MAXIMA IN THE PASSBAND (P) 
MAXIMA IN THE STOPBAND (S) 


AND S-DOMAIN 


0.1606 
0.4071 
0.1804 
0.4495 
0.2269 
0.8845 
0.2852 
0.0582 
0.3205 
0.1145 
0.1264 


6. 


= 0. 


c1(L) co(L) 
-1.57226563 0.74218750 
-1.52148437 0.93359375 
-1.46679687 0.78515625 
-1.88085937 0.96679687 
-1.77539063 0.87500000 
STEP 
c= 2.4105675 
0013992 = 6.14692 PERCENT 
0091129 = 91.12871 PERCENT 
ZEROS 
0.704866 +-J« 0.709340 
0.546626 +-J« 0.837377 
-1.000000 +-J« 0. 
1.000000 +-J« 0. 
0.982093 +-J« 0.188399 
0.969864 +-J« 0.243648 
c1(L) co(L) 
-1.52112896 0.93239814 
-1.46349257 0.78417628 
-1.56901532 0.73926776 
-1.77572700 0.87360604 
-1.88183418 0.96743870 


Z-DOMAIN MAGNITUDE 

IN RAD IN DEGREE 

0.3184 18.2449 1.000001 
0.7733 44.3070 0.009113 
0.3571 20.4577 1.000000 
0.8449 48.4102 0.009113 
0.4462 25.5628 1.000000 
1.4483 82.9829 0.009113 
0.5556 31.8355 1.000000 
0.1162 6.6600 0.009113 
0.6203 35.5398 1.000000 
0.2280 13.0618 0.009113 
0.2515 14.4078 0.009113 
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MINIMA IN THE PASSBAND (P) 
MINIMA IN THE STOPBAND (S) 
BAND S-DOMAIN 


ya 


QAVHVHNVHAH 


0.1584 
0.4161 
0.1676 


QO. 
0. 
0.8507E 38 


5414 
2003 


IN RAD 
0.3142 
0.7886 
0.3320 
0.9925 
0.3954 
3.1416 
0.5029 
oO. 

0.5959 
0.1895 
0.6283 
0.2461 


LAYOUT OF THE ROUNDED COEFFICIENTS 


WORDLENGTH an) 
COEF 

B2( 1) 0.54687500= 
B2( 2) 0.25000000= 
B2( 3) 0.55468750= 
B2( 4) 0.69140625= 
B2( 5) 1.60546875= 
Bi( 1) -0.77148437= 
B1i( 2) -0.27343750= 
B1( 3) ~1.07617188= 
B1( 4) -1.35742187= 
B1( 5) 0. = 
BO( 1) 0.54687500= 
BO( 2) 0.25000000= 
BO( 3) 0.55468750= 
BO( 4) 0.69140625= 
BO( 5) -1.60546875= 
c1( 1) -1.56835937 

c1( 2) -1.52148437= 
c1( 3) -1.46289063= 
c1( 4) -1.88085937= 
e1( 5) -1.77539063= 
co( 1) 0.74023438= 
co( 2) 0,93164062= 
co( 3) 0.78320312= 
co( 4) 0,96679687= 
co( 5) 0.87304687= 


DOMAIN MAGNITUDE 
IN DEGREE 
18.0000 0.998602 
45.1813 oO. 
19.0251 0.998601 
56.8642 0. 
22.6550 0.998601 
180.0000 0.000000 
28.8158 0.998601 
0. QO. 
34.1450 0.998601 
10.8594 5 
36.0001 0.998601 
14.1019 0.000000 
COEFS IR IE ID 
0.27343750«2«*( 1 - 0) 2#+-100 
0. aap neaeosa eet 1- 0) 2*«-100 
0.27734375«2 1- 0) 
0. 3457031202001 1- 0) 
0.80273438s26( 1 - 0) 2**-100 


-0.3857421942e« 
-0.1367187 
-0.5380859442. 
-0.67871094e2 
0. *2e« 


0,27343750«2e«( 
0.12500000«. ( 
0.27734375*2 : 
0.34570312«, 
-0. 302734a8eae0t 


1 


-0.78417969«2. 
-0. 7e07421 90200 
-0.73144531s200( 
-0.94042969«2s0( 
-0.88769532«2««( 


0.37011719#24«( 
0.46582032+2+«( 
0.39160156+2+#( 
0.4833984442+«( 
0.43652344+2+«( 


SEARCH OF MINIMUM WORDLENGTH 


IwL 
41° 


EPS-P 
0.557585 


E 
0.9) 


BLOCKS OF SECOND ORDER 


CONSTANT GAIN FACTOR = 


L 
1 
2 
3 
4 
5 


B2(L) 
0.54687500 
0.25000000 
0.55468750 
0.69140625 
1.60546875 


Bl 
-0.77 
-0.27 
-1.07 
-1.35 

o. 


‘PS-S PMAX 
91198 0.984173 


0.1058192E 00 


(L) BO(L) 
148437 0.54687500 
343750 0.25000000 
617188 0.55468750 
742187 0.69140625 
-1.60546875 
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0) -26-100 
0) -2) 100 
0) -2*«-100 
0) -2*#-100 
0) 2*-100 


0) 2**-100 


0) 2**-100 
0) -2+*«-100 
0) 
0) 
0) 
0) -248-100 
0) -24#-100 


0) 20*-100 
0) 2**-100 
0) 2**-100 
0) 264-100 
0) 2**-100 


c1(L) 
-1.56835937 
-1,52148437 
-1.46289063 
-1.88085937 
-1.77539063 


OCTAL 


021400000000 
010000000000 
021600000000 
026100000000 
063300000000 


147240000000 
167200000000 
135440000000 
124440000000 
100000000000 


021400000000 
010000000000 
021600000000 
026100000000 
114500000000 


115640000000 
117240000000 
121140000000 
103640000000 
107140000000 


027540000000 
035640000000 
031040000000 
036740000000 
033740000000 


co(L) 
0.74023438 
0.93164062 
0.78320312 
0.96679687 
0.87304687 
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REALIZED STRUCTURE ISTRU = 23 
SCALING OPTION IscAL = 0 
BY A FACTOR OF POWER TWO NO 
CHOSEN MAXIMUM OF THE 
OVERFLOW POINTS SCALM = 0.990 
REALIZATION OF THE COEFFICIENTS 
CONSIDERATION OF THE QUANTIZATION YES 
WORDLENGTH IWLR = 11 


(FOR IWLR=100 NO ROUNDING) 


NUM DEN SCALING UNCOR. NOISE COR. NOISE 


DC-OFFSET CHA CO-QUAN 


1 3 1.000000 0.42382E 02 0. QO. 
2 1 1.000000 0.63044E 02 0. oO. 
5 2 1.000000 0.33679E 02 0. 0. 
4 5 1.000000 0.52348E 03 0. 0. 
3 4 1.000000 0.16769E 03 0. 0. 
0 0 1.000000 0.10324E 01 0. 0.19845E-02 


0.19845E-02 
TOTAL NOISE 0.83131E 03 0. 
ABSOLUTE OUTPUT NOISE ANP = 0.67100E 02 (QQ) 
SCALING AT THE OUTPUT SCA = 0.98417E 00 
RELATIVE OUTPUT NOISE RNP = 0.69276E 02 (Q#Q) 
RELATED TO MAX /H/ = 1 
INNER NOISE FIGURE RIN = 0.83131E 03 (Q*Q)/12 = 
RELATED TO MAX /H/ = 1 
ENTRANCE NOISE FIGURE REN = 0.11864E 00 
RELATED TO MAX /H/ = 1 
ADDITIONAL WORDLENGTH DELTA W = / 4.769/ = 5 
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BLOCKS OF SECOND ORDER 


CONSTANT GAIN FACTOR = 


L 
1 
2 
3 
4 
5 


B2(L) 
0.54687500 
0.25000000 
0.55468750 
0.69140625 
1.60546875 


DATA INPUT 


* 


6 30 T 


MAGNITUDE X 


QO. 


0.279E-02 0.026 
0.536E-02 0.051 
0.749E-02 0.077 
0.884E-02 0.102 
0.897E-02 0.128 
0.729E-02 0.153 
0.315E-02 0.179 
0.339E-02 0.204 


0.147E 00 0.715 
0.532E-01 0.741 
0.144E-01 0.766 
0.160E-02 0.792 
0.757E-02 0.817 
0.898E-02 0.843 
0.833E-02 0.868 
0.680E-02 0.894 
0.496E-02 0.919 
0.311E-02 0.945 
0.135E-02 0.971 
0.234E-03 0.996 
0.164E-02 1.022 
0.287E-02 1.047 
0.394E-02 1.073 
0.485E-02 1.098 
0.563E-02 1.124 
0,629E-02 1.149 
0.685E-02 1.175 
0.732E-02 1.200 


0.288E-03 3.091 
0.144E-03 3.116 
0.112E-10 3.142 


eee ee ee ee ok eee Oc 


B1(L) 


-0.77148437 

-0.27343750 

-1.07617188 

-1.35742187 
oO. 


0.1058192E 00 


0.54687500 
0.25000000 
0.55468750 
0.69140625 
-1.60546875 


MAGNITUDE OF 
0.400 


BO(L) 


o. 


c1(L) 


-1.56835937 
-1.52148437 
-1.46289063 
-1,88085937 
-1.77539063 
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co(L) 
0.74023438 
0.93164062 
0.78320312 
0.96679687 
0.87304687 


THE FREQUENCY RESPONSE 


0.800 
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DATA INPUT 
* 6 40° 2 0 Qo. oO. oO. 


ATTENUATION OF THE FREQUENCY RESPONSE 
MAGNITUDE X 40.000 80.000 
0.163E 03 0. 
0.511E 02 0.026 . 
0.454E 02 0.051 . . 
0.425E 02 0.077 . . 
0.411E 02 0.102 . . 


0.409E 02 0.128 . 
0.427E 02 0.153 . 
0.500E 02 0.179 . 
0.494E 02 0.204 . 
0.422E 02 0.230 . 
0.342E 02 0.255 . 
0.113E 02 0.281 . 
0.516E 00 0.306 + 
0.244E 00 0.332 + 
0.240E 00 0.358 + 
0.236E 00 0.383 + 
0.213E 00 0.409 + 
0.179E 00 0.434 + 
0.158E 00 0.460 + 
+ 
+ 
+ 
+ 
+ 
+ 
+ 


eee ee 


0.152E 00 0.485 
0.148E 00 0.511 
0.140E 00 0.536 
0.141E 00 0.562 
0.156E 00 0.587 
0.158E 00 0.613 
0.310E 00 0.639 
0.237E 01 0.664 
0.860E 01 0.690 
0.167E 02 0.715 
0.255E 02 0.741 
0.368E 02 0.766 
0.559E 02 0.792 . . 
0.424E 02 0.817 
0.409E 02 0.843 
0.416E 02 0.868 
0.434E 02 0.894 
0.461E 02 0.919 
0.502E 02 0.945 
0.574E 02 0.971 
0.726E 02 0.996 
0.557E 02 1.022 
0.508E 02 1.047 
0.481E 02 1.073 
0.463E 02 1.098 
0.450E 02 1.124 
0.440E 02 1.149 
0.433E 02 1.175 
0.427E 02 1.200 
0.423E 02 1.226 
0.419E 02 1.252 
0.416E 02 1.277 
0.414E 02 1.303 
0.413E 02 1.328 
0.411E 02 1.354 
0.411E 02 1.379 
0.410E 02 1.405 
0.410E 02 1.430 
0.410E 02 1.456 


0.708E 02 3.091 
0.768E 02 3.116 
0.163E 03 3.142 


H 


DATA INPUT 
4/1 
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3.4 Analysis of a given digital filter 


//20N 

#0110 
*0010 
#0010 
#0010 
#0010 
#0010 
*0010 
#0010 
#0510 
#0520 
*0620 
#0630 
*0650 
*0660 
//¥I 


*0110 
*0620 
*0510 


*0520 
*0630 


The coefficients of the given cascade of second-order blocks are read in directly 
by the data input mode 3 (results of example 3.2). 


For the noise analysis, pairing and ordering will be done in the sequence of the 
coefficient input. For the realization structure 16 (Fig. 9) is assumed again. 


Yet, instead of mathematical rounding, unsymmetrical sign magnitude trunca- 
tion is used for the nonlinearities. 


After the noise analysis a printer plot of the frequency response in the region of 
2=0.0 to 0.8 is given in the same program section. 


The input data cards for this analysis are given here. 


= 


4 
1 
1 


eco 


0.8046875 
0.4765625 
-0,96875 0,2578125 


3.5 Design and analysis with different parameters 
3.5.1 Filter Design 


*0130 


In the first program activity //SY a lowpass filter will be designed, according to 
the specification in sect. 3.1.1. The results are output on the line printer and 
additionally stored on the disk (channel number KA4) to save the original 
(unrounded) coefficients for further program sections. The input data are 
shown in sect. 3.5.4. 


3.5.2 Noise Analysis of the Designed Filter 


*0530 


In the second program activity //AN the filter parameters and coefficients are 
read in from the disk. Besides the default parameter for the filter realization 
the actual coefficient wordlength is assigned to IWLR=12 bit by the control 
card *0530. (Attention: Don’t mix up the parameter IWLR with IWL for the 
optimization.) 


Scaling is done by the absolute criterion, and the chosen maximum is set to 
SCALM=0.99 (see sect. 3.3.2). For the noise analysis the ordering of the 
second-order blocks will be arranged according to the special input. 


3.5.3 Frequency Response for Rounded Coefficients 


*0530 
*0630 
*0640 


*0110 


The actual coefficient wordlength is defined by the parameter IWLR. To avoid 
a double rounding of the coefficients, the printer plots for frequency responses 
with different coefficient wordlength have to be done in separate program sec- 
tions. 


At the beginning of each activity the original coefficients are read in from the 
disk, initialized by the parameter NIMP=2. 
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*0630 Then, the normalized printer plots (length one page) are output on the line 
*0640 printer for the magnitude and the attenuation of the frequency response. 


3.5.4 Necessary Input Data Cards 


Four separate activities are necessary only in computers where it is illegal to follow a write-disc with a 
read-disc, 


//8Y 

#0130 T 

#0310 20. 

#0341 2. 4. 
#0351 0.02 0.001 
//FI 

//3N 

#0110 2 
#0530 12 
#0620 T 1 
*0040 3 
#0040 3 
#0630 T 

*0640 T 1 
4/¥I 

/7AN 

#0110 2 
#0530 10 
#0630 T | 
#0640 T 1 
//¥FI 
//7BN 
#0110 
#0530 
#0630 
#0640 
4/PI 


88 
a20n 


4. Considerations for the Installation of the Program on a Special Computer 
4.1 Language 


DOREDI is written in FORTRAN and follows ANSI FORTRAN conventions very closely. The param- 
eters and variable names are limited to six characters. Only the DECODE statement, permissible for 
most of the compilers, is used in addition. If DECODE or a corresponding statement is not available 
on the compiler in use, the alternative input format should be chosen for the program section and the 
input data cards (see sect. 2.2). Therefore, the input subroutines INP0O1, INP002, and INP003 have to 
be changed according to the remarks in the beginning of these subroutines before compilation. Corise- 
quently, for the alternative input format the parameters ACX, EDEG, OMLO and RMIN cannot have 
automatic default values. The defined default values are active as long as the parameter is not explicitly 
redefined by the use of an input card including this parameter; e.g., for the definition of a fixed filter 
degree NDEG=10, with input in the normal format 


*0330 10 
the default degree extension EDEG =0.2 has to be set, for the alternative input format, too. 
*0330 10 0.2 


4.2 Declarations, depending on the computer used 


All declarations depending on the computer precision and special I/O-handling have to be defined by 
the PORT Mathematical Subroutine Library (see Standards chapter of this book). The functions 
ILMACH, RIMACH, and DIMACH are all required. 


4.2.1 Format for Input of Hollerith Characters 


The format must be modified to accommodate the machine in use. The following example applies only 
to the PDP 11/45. 
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IOFO. FORMAT statement for the input of 80 
Hollerith characters 


n = number of INTEGER 


(n Am) 
m = number of characters 
encoded by one INTEGER 
n«*m = 80 
ION n 


For the PDP 11/45 


DATA IOFO/2H (4,2HOA,2H2)/,ION/40/ 


4.2.2 Special Parameters for the Design and Optimization 


| | PDP 11/45 | 
MAXDEG | maximum filter degree + 32 
MBL maximum number of blocks of second order + 16 
IWLMI minimum coefficient wordlength for the optimization iz 
IWLMA maximum coefficient wordlength for the optimization 
(< wordlength of REAL mantissa) 24 


4.2.3 Subroutine for SPECIAL OUTPUT 


In order to implement a special output, like a paper tape running on a “hardware filter", the user has to 
replace the dummy subroutine "OUTSPE" by his own. The parameter ISPOUT, see sect. 2.2.1.4, can 
be used to generate several output options. The dummy subroutine is listed as an example below: 


OUTSPE 


SUBROUTINE OUTSPE 


c 
COMMON /CONTR / IPRUN,IPCON,NINP,NOUT,NDOUT,LSPOUT,ISPOUT 
COMMON /CANPAR/ KA1,KA2,KA3,KA4,KA5,LINE 
c 
c DATA TRANSFER BY NAMED COMMON BLOCKS: 
c 
COMMON /FILT / NB,FACT,B2(16),B1(16) ,B0(16),C1(16),C0(16) 
c 
c ISPMAX: MAXIMUM NUMBER OF IMPLEMENTED OPTIONS 
ISPMAX=0 
c 
IF(ISPOUT.LE.0) RETURN 
IF(ISPOUT.GT.ISPMAX) GO TO 900 
c 
c EXAMPLE FOR ISPMAX=3 
c 


+ A change of the parameters MAXDEG and MBL entails a change of all COMMON- and DIMENSION-statements, depending 
on these parameters. 
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GO TO (100,200,300) ,ISPOUT 

100 CONTINUE 
OPTION NO. 1 
RETURN 


20 


° 


CONTINUE 
OPTION NO. 2 
RETURN 

300 CONTINUE 
OPTION NO. 3 


RETURN 


eanaaaaaaAanAaAaaaAana 


900 CALL ERROR (8) 
RETURN 
END 
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A.1 General description of the coefficient realization 


For the realization of coefficients with finite wordlength a general description, including the fixed-point 
and "pseudo"-floating-point realization as well as the realization by differences, is useful. The difference 
tealization seems to be appropriate for coefficients in the region of the largest possible numbers, espe- 
cially in connection with the "pseudo"-floating-point implementation [4]. The coefficients of the 
transfer function, 

1 byz? + bz + boy 


7 (Al) 
ay ee ee eye 


H(z) = by 
x 


are renamed by 
(b2,,b1,,5ox-C1n-Cord = yas v= 10S. (A2) 
The a,, are divided by Eq. (A3) according to Fig. Al. 


2'°v sgnlays') 


ir, ~ie. 
ay yee Mae |} 
Fig. Al "Pseudo"-floating point and difference realization of coefficients. 
ip i 
a, =a',,2" “— sen(a',,)2°", (A3a) 


"pseudo"-floating-point 


a’, = (ay, — sen(a,,)2?)2% Re (A3b) 


For the difference realization the exponent ip, is calculated as 

ip,, = <loga|a,,|> (A4) 
otherwise the exponent is fixed to jp | = —100; with the definition 2-' = 0. <x> means the smallest 
integer greater than or equal to x. 
Since the realized coefficient a’‘,, has to be in the range —1 < a',, < 1, ig, describes the number range 
for the coefficients with the same index v, 


‘ Wy 
ig, = <log, max {la,, — 2" sen(a,,)|}> (AS) 


The "pseudo"-floating-point realization with no forced normalization is represented by only the positive 
exponent ig, 


—[log;(a,,—sen(a,,)2)2 *] 
ic,, = min (A6) 
Ean 
with the maximum exponent ‘gg, and the definition [x] meaning the largest integer less than or equal 
to x In this description with ee —100 and a 0 the simple fixed-point implementation is 
included. 
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B.1 Characteristics of the nonlinearities 


Both the character and the power of the error at the output of a general transfer system (see Fig. B1) 
depend upon the characteristics of the nonlinearities applied [1], [4]. A nonlinearity may produce 
errors of variance o?‘%) which exhibit no correlation with the signal, DC-offsets of size A,, and errors, 
described by the value e,‘5), which are correlated with the signal (see Fig. B2). Furthermore, DC- 
offsets and correlated errors are correlated with each other. 


The partial errors can be determined following [4], [7], [8]. The quantization characteristics and the 
error values of the different nonlinearities are given in Table B1. 


Reorralntion 


TN 


ey 


——s .) (2) pee 


—_ F, a nr (ss 
‘ 

: | 
2 


Fig. B1 General transfer function system. 


correlated with 
‘the other corresponding sources 


Fig. B2 Model of the nonlinearity. 


B.2 Limitation of the error analysis 


For reasons of computation time, the correlated errors are calculated, here, according to the simpler 
linearized model [8]. Furthermore, during the optimization only error correlations within the second- 
order blocks can be taken into account. In the final analysis, however, all correlations are regarded. 
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Table B1 Characteristics of the nonlinearities. 
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C.1 Fixed pairing 


To reduce the necessary computing time for the optimization of the state variable wordlength, a simple 
heuristic method can be used to get a predetermined combination of poles and zeros [1],[4],[6]. To get 
the fixed pairing, in a first step those poles and zeros are combined which are situated most closely to 
each other. Then, without taking into account poles and zeros regarded before, the following steps 
repeat this procedure. The output of the filter synthesis obeys this rule. 


For the first canonical form (Fig. 2) the paired poles and zeros are ordered directly in the blocks of 
second order (Fig. Cl). By means of a simple consideration this rule can be extended for the second 
canonical structure. The numerator function of one block may be thought of as being combined with 
the denominator function of the following block in an auxiliary block [6]; if the rule, mentioned above, 
is applied to these auxiliary blocks, a predetermined combination for the second canonical form is possi- 
ble, too. The scheme in Fig. Cl explains the different pairings for the two canonical forms. 


' ' 
: 1 2 3 a 5 ' Numerator 

aati tetas etatetatatety tenets ietatatately (steteiataanat Ted 18 canonical form 
' ' 
tt 2 3 4 BR Denominator 


Numerator 
2"4 canonical form 


Denominator 


Fig. C1 Pairing of poles and zeros. 
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D.1 Parameters for the coefficient optimization 


For a tolerance scheme, given by 2p, 5, 5p and 5s, a minimum filter degree ni, is found by 

Mmin = S(Np, As, Bp, Ss) , 
see [1], [2] and [4]. This nin is not necessarily an integer value. Taking the smallest integer n on 
condition that n > mpi, and utilizing the total transition band, an unused margin in the passband or 
stopband tolerances remains. According to the choice of the design parameter C, this margin can be 
partitioned to the passband and to the stopband. For C = C,,;,, the total stopband tolerances are ‘util- 


ized for the approximation, and the passband ripple receives a minimum. On the other hand, for 
C = Cyax the total passband tolerances are utilized [1], [4]. 


Cmin = Si\(Xp, Xs, bp, Bs, n) 


Cage fp DD gpaphagen) 


Rounding the coefficients of the transfer function leads to errors not proportional to the passband or 
stopband ripples, in general. For this reason, the parameter C can be used as an additional variable for 
the design of digital filters with rounded coefficients. 


In DOREDI, the optimization of C (Cyn < C < Cmax) is done by a trial and error procedure such 
that the required wordlength of the rounded coefficients is small [3], [4]. 

Finally, the parameter C is normalized to the border values Ci, and Cy, in order to get a uniform 
variation range in different filter designs: 

logio C = 10810 Crmin 


ACX = ¢ = —_—___—"_*- 
10810 Cmax — 10810 Cin 


Hee hie a 
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Error diagnostics 
Description 


Unexpected input code 

Input data card out of sequence 
Undefined program section name 
Illegal input data 

Parameter out of defined range 
Sampling frequency not defined 
Sampling frequency multi defined 
Not implemented 

Meaningless input data 

Lower bound greater than upper bound 
Missing //FI card 

No input data available 


Filter degree given by input data too small — filter 
degree chosen automatically or program aborted 
Coefficient wordlength out of range 


Not defined filter type 

Not defined approximation type 

Cutoff frequencies not in ascending order 

Missing or illegal definition of the cutoff frequencies 
Missing definition of the tolerances 

Necessary filter degree too high 

Missing filter coefficients 


System not stable 

No fixed pairing possible 
Zeros not on the unit circle 
More than one pole at z = 0 


Option not implemented — Stop 
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Control data input cards 


CLASS 01 CLASS 04 

*0110 bb,NINP *0410 LSTAB,IWL 
*0120 bb,NOUT *0420 RCOINP,JRCO 
*0130 LDOUT *0430 ECOINP,JECO 
*0140 LSPOUT,ISPOUT *0440 DCOINP,JDCO 


*0450 bb, JMAXV 
*0460 bb, JTRB2 


CLASS 02 CLASS 05 

*0210 LWLF,ITERM,ACX,ACXMI,ACXMA | *0510 LPOT2,ISTRU 
*0220 bb, ITERMI *0520 CNOINP,JCNO 
*0230 LPAIRF,ISTOR *0530 LNCO,IWLR 


*0240 LSEQ,ISCAL,SCALM 


CLASS 03 CLASS 06 

*0310 bb, ITYP,SF *0610 LWL,IWL 

*0320 bb, [APRO,ACX *0620 LSEQ,ISCAL,SCALM 

*0330 LDEGF,NDEG,EDEG *0630 LNOR,IPAG,OMLO,OMUP,RMAX 
*0341 bb,bb,FR(1),FR(2),SF *0640 LNOR,IPAG,OMLO,OMUP,RMAX 
*0342 bb, bb, FR (3),FR(4),SF *0650 LNOR,IPAG,OMLO,OMUP 

*0343 bb,bb,OM(1),OM(2) *0660 LNOR,IPAG,RMIN,RMAX 


*0344 bb,bb,OM(3),OM(4) 
*0345 bb,bb,S(1),S(2) 

*0346 bb,bb,S(3),S(4) 

*0347 bb,bb, VSN, VD,A 
*0351 bb,bb,ADELP,ADELS 
*0352 bb,bb,AP,AS 

*0353 bb,bb,P,AS 

*0360 bb,NORMA 

*0370 LSOUT 
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Program for Minimum —p Synthesis of 
Recursive Digital Filters 


A. G. Deczky 
Institut de Microtechnique 
Universite de Neuchatel 
Rue de la Maladiére 71 
2000 Neuchatel, Switzerland 
1. Purpose 
This program performs the synthesis of recursive digital filters using a minimum p error criterion 
and the method of Fletcher and Powell [2] for function minimization. 
2. Method 
The method is outlined in detail in [1]. The Fletcher-Powell subroutine is taken from [3], but has 
been modified extensively such that the version included here should be used. 
3. Program Description 
3.1 Usage 


The program is self contained with all the necessary subroutines for input and output. The input 
section is also documented with a short description of each of the input parameters. 


The program expects the primary input parameters on unit IND=IIMACH(1) and outputs the 
results on unit IOUTD=IIMACH(2). The final filter coefficients are also output on unit 
IOUTP=IIMACH(3). This could be used for later input, or for producing punched cards, etc. Finally 
in the case of the group delay equalizer, the coefficients of the filter to be equalized are read in from 
unit INP which is set to IMACH(1). The format expected here is: 


E14.7,14 = CONST, N 
5E14.7_ = AO(1), Al(1), A2(1), BI(1), B2(1) 


5E14.7 = AO(N), A1(N), A2(N), B1(N), B2(N) 
This same format is used for outputting the final filter coefficients on unit IOUTP=I11MACH(3). 


The program minimizes one of the following three functions: 


NP 
Fl= a WH(J)*(X(N)*H(X,J) — FS(J)}**1P (1) 
il 
P 
F2 = > WG(J)*{DG(X,J) — DGS(J) — X(N)}*"1Q (2) 


Jel 


NP 
F3 = ALFA } WH(J)*{X(N—1)*H(X,J) — FS(J)}**IP 
J=1 


NP 
+ (1 — ALFA) } WG(J)*{DG(X,J) — DGS(J) — X(N)}**1Q (3) 
J 
where 
Fl is used for magnitude approximation 
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F2 is used for group delay approximation or group delay equalization 

F3 is used for combined magnitude and group delay approximation 

x is the argument vector and contains the zeros and poles in polar coordinates 
ti corresponds to a frequency, as discussed below 

FS is the desired magnitude function at the frequency point corresponding to J 
DGS is the desired group delay function at the frequency point corresponding to J 


ALFA is a weighting coefficient between 0 and 1 for the magnitude in the case of com- 
bined approximation. 


WH(J) is a weighting function for the magnitude at the frequency point corresponding to 
J 


WG(J) is a weighting function for the group delay at the frequency point corresponding 
toJ 


H(X,J) is the magnitude of the filter which is a function of the argument vector X and 
the frequency point J 

DG(X,J) is the group delay of the filter which is a function of the argument vector X and 
the frequency point J. 


IP,IQ are indices for the magnitude and group delay error respectively. They should be 
positive and even. 


The above functions are computed on a number NK of intervals. These intervals are specified by 
their end points FIK(I) and FIK(I+1) and their number I, I= 1, NK. The number of points on each 
of these intervals is designated by NPK(I), I= 1, NK. The frequency points J are assigned to each 
interval depending on the parameter WEIGHT(I) as follows: 


WEIGHT(I) J corresponds to the frequency 


1 (FIK (1+1)—FIK (1))* J—JO—1)/NPK (D+FIK (D) equispaced 

2 (FIK (I+1)—FIK (1))*SIN{(J—JO= 1)* (PI/2)/NPK (1) ]+FIK(D sine half cycle 
<] (FIK (I)—FIK (1+1))*COS{ (J-JO-1)*(PI/2)/NPK(1)}+FIK(I+1) cosine half cycle 
4 0.5* (FIK (1) —-FIK (I+1))*COS{ (J-JO—1)*PI/NPK (1) + cosine full cycle 


0.5* (FIK (I) +FIK (I+1)) 
where 


—1 
J0 = 5 NPK(k) 
Kel 


If NPK(1) = 0, no frequency points are assigned to that interval. This could be used to designate a 
"don’t care" interval. 


The real weight functions WH(J) and WG(J) are constant over any given interval I and are specified 
by the functions WHK(I) and WGK(I), i.e., 


WH(J+JO) = WHK(I) for J = 1,NPK(1) 
WG(J+JO) = WGK(I) for J = 1,NPK(I) 


The indices IP, IQ are specified by the input parameters IP(II), IQ(II), Il = 1,IPK. They should be 
even. If a large index is to be used a sequence such as 2, 4, 10 is recommended. The largest index 
used should be about 10. 


The argument vector X contains the zeros and poles in polar coordinates. On input it specifies the 
initial position of the zeros and poles, while on output it gives their position at the attained minimum 
of F. The zeros are partitioned into real ones, ones on the unit circle and complex ones, while the 
poles are partitioned into real and complex ones. Real zeros and poles are specified by their radii. 
Complex zeros and poles are specified by their angle expressed as a frequency (i.e., angle in radi- 
ans/(27) x sampling frequency) followed by their radii, in pairs. Finally zeros on the unit circle are 
specified by their angle. The number of real zeros, zeros on the unit circle, complex zeros, real poles 
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and complex poles are specified by NZR, NZU, NZC, NPR, NPC in that order. (Note that only zeros 
(poles) with positive angles are specified, their complex conjugate pairs being understood.) The last 
parameter X(N) is a multiplying constant KO for the magnitude for magnitude approximation and an 
added constant TAUO for the group delay for group delay synthesis or equalization. For the case of 
combined magnitude and group delay equalization X(N—1) is KO and X(N) is TAUO. 


The required magnitude and group delay functions FS and DGS have to be provided by separate 
subroutines. A typical subroutine structure is given with the examples below. In the case of group 
delay equalization, the array DGS(J) is set equal to minus the group delay of the filter to be equalized, 
the latter being calculated on the basis of the coefficients read in on unit INP=IIMACH(1). 


3.2 Types of Output 


The program essentially computes an argument vector X and a gradient vector G corresponding to 
the minimum of the function Fl, F2, or F3 above. Based on X, the zeros and poles as well as the 
coefficients of the cascade realization of the filter are computed. Optionally the frequency response is 
also given. 


Generally two types of output may be obtained. The first type is printed in 72 column format for 
output on a teletype or printer, and consists of either a short output summarizing the results of the 
minimization (LONG=.FALSE.) or a longer output also giving the progress of the minimization 
(LONG=.TRUE.). Examples of both are given below. 


The second type of output is strictly for debugging purposes, and produces extensive intermediate 
results in 72 column format to monitor the progress of the entire program. This should only be used as 
a debugging aid by persons thoroughly familiar with the program. This output is suppressed by setting 
both DEBFP and DEB to .FALSE. in the input sequence. 


3.3 Description of Parameters 
This is given in the input section of the program and is reproduced here for convenience. 
MODE Type of approximation 


=1 magnitude only 

=2 group delay only 

=3 group delay equalization 
=4 magnitude and group delay 


NZR Number of real zeros 

NZU Number of zeros on the unit circle 

NZC Number of complex zeros 

NPR Number of real poles 

NPC Number of complex poles 

x Initial parameter vector. Zeros and poles specified in polar coordinates as follows. 


Real zeros first followed by zeros on the unit circle, complex zeros, real poles, and 
finally complex poles. Real zeros (poles) are specified as radius] ,radius2,...; zeros on 
the unit circle are specified as anglel,angle2,..., complex zeros (poles) are specified as 
angle1l,radiusl,angle2,radius2,..., where the angles are specificed in Hz as 
phi/(27r)*fsample and only zeros (poles) with positive angles are specified, their com- 
plex conjugate pairs being understood. The last parameter(s) is (are): 


KO if mode = 1 
TAUO if mode =2,3 
KO,TAUO if mode =4 


NK Number of intervals 
NPK(I) Number of points on the interval FIK (I)—FIK (I+1) 
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WEIGHT(I) Spacing of the points NPK(I) on the I'* interval 


= 1 points equispaced 

= 2 points spaced on a sine abscissa half cycle 

= 3 points spaced on a cosine abscissa, half cycle 
= 4 points spaced on a cosine abscissa, full cycle 


WFK (I) Relative weighting of the I" interval for the magnitude 
WGK(I) Relative weighting of the I'" interval for the group delay 


FIK (I) Starting point of the I'" approximation interval 

IPK Number of successive indices of approximation 

IP(II) Successive indices of approximation for the magnitude 

IQ(d1) Successive indices of approximation for the group delay 

INV Number of total cycles if no convergence 

Fl Lower frequency limit for the frequency response 

F2 Upper frequency limit for the frequency response 

FSAMPL Sampling frequency 

IZ Number of points for the frequency response (IF IZ < 0 no response is calculated) 
ALFA Relative weighting of the magnitude 


Relative weighting of group delay is 1.—-ALFA 
This parameter is used only if MODE=4 


LONG Logical parameter for type of output 


= .TRUE. for LONG output 
= .FALSE. for SHORT output 


LIMIT Number of iterations per cycle before restarting with steepest descent 
EPS Error parameter for FMFP subroutine — typically 10~> 
DEB For debugging printout set = .TRUE. 


DEBFP For debugging printout from FMFP set = .TRUE. 


This completes the description of the input parameters. 
IER Used on output to indicate: 


—1 repeated failure of iteration 

0 convergence 

1 failure of convergence in the specified number of iterations 

2 failure of linear search to find a minimum along the direction vector 


If IER = 0 and the results are not satisfactory, the program could be restarted with the final argu- 
ment vector as the initial condition. If INV is greater than 1 when IER = 0, this will happen automati- 
cally. 


3.4 Dimension Restrictions 


The number of parameters in X is restricted to 40. The number of filter sections is restricted to 20, 
The total number of points over which F is computed is restricted to 201. The total number of points 
for the frequency response is also restricted to 201. The number of successive indices IP, IQ is res- 
tricted to 10. The number of intervals FIK is restricted to 10. To change any of these, modify the 
appropriate DIMENSION or COMMON statement(s). 
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4, Examples 


Five examples will be given to illustrate how the program works. For each example we give the 
input sequence, the functions FS and DGS (or the input coefficients of the filter to be equalized in 
example 2), followed by the complete output as specified by the input sequence. 


Example 1 


This example illustrates the synthesis of a recursive low pass filter of order 4. The magnitude of the 
filter is to approximate 1 in the range 0 to 3 and 0 in the range 3.4 to 4. There are thus three intervals, 
namely from 0 to 3, from 3 to 3.4 and from 3.4 to 4, with the second one being a "don’t care" interval 
-- hence NPK(2) = 0. The initial argument vector is given as two zeros on the unit circle specified by 
the parameters 3.6 and 3.8, plus 2 complex poles specified by the parameters 1.6, 0.8 and 2.4, 0.8. 
(Note that only the zeros and poles with positive angles are specified -- the complex conjugate ones are 
understood.) The program output is specified as LONG. The input parameters, the magnitude 
specification function FS and the program output are given in Tables 1, 2 and 3 respectively. 


Example 2 


This example illustrates the group delay equalization of a recursive low pass filter. The coefficients 
of the filter to be equalized are used as input on unit INP=IIMACH(1). They are reproduced in Table 
4, together with the input parameters. LONG output is again specified and is given in Table 5. 


Example 3 


This example illustrates the approximation of the ideal differentiator FS(FI) = FI on the interval 0 
to 1 (with a sampling frequency of 2). Note that now 3 indices IP(II) are specified in the sequence 2, 
4, 10 and the program should restart a maximum of 4 times if no convergence is attained. The input 
parameters for this example are given in Table 6, the magnitude specification function FS is given in 
Table 7 and the (specified) LONG output is given in Table 8. 


Example 4 


This example illustrates the approximation of a rising group delay function DGS(FI) = 15.0*FI 
using an all pass filter of order 8. The input parameters for this example are given in Table 9, the 
group delay specification function DGS is given in Table 10 and the (LONG) output in Table 11. 


Example 5 


This example illustrates the approximation of a recursive low pass filter with both specified magni- 
tude and a group delay. The magnitude is to be 1 from 0 to 0.3 and 0 from 0.6 to 1.0 while the group 
delay is to be 4 from 0 to 0.5. (The sampling frequency is 2.0.) Thus now there are four intervals; 0- 
0.3, 0.3-0.5, 0.5-0.6 and 0.6-1.0. The second and third intervals are "don’t care” intervals for the mag- 
nitude with WHK(2) = WHK(3) = 0, while the last two are "don’t care" intervals for the group delay 
with WGK(3) = WGK(4) = 0. The input parameters for this example are given in Table 12, the mag- 
nitude and group delay specification functions FS and DGS are given in Table 13, and the (LONG) 
output in Table 14. 


References 
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Table 1 


Cc FUNCTION 
C FUNCTION FOR SPECIFYING THE REQUIRED MAGNITUDE 


FS 


10 
20 
30 
40 


50 
60 


FUNCTION FS(FI) 
COMMON /CM40/ FIK(10), 
COMMON /UNIT/ IND, INP, IOUTD, IOUTP, PI, SPM 


DO 60 K=2,NK 
=K-1 


Ki 


IF 


Go 
FS 
Go 
FS 
GO 
FS 
fev} 
FS 
GO 
FS 


(FI.LT.FIK(K1) 
TO (10, 


= 1.0 


CONTINUE 
RETURN 


END 


NPK(10), NK 


+OR. FI.GE.FIK(K)) GO TO 60 


30, 40, 50), K1 
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KO = 


0 .92072797E-01 


F= 0.20112E 01 


IER= 0 


NO OF FUNCT EVALUATIONS= 


Table 3 


NO OF ITERATIONS= 0 


2 


INITIAL ARG. VECTOR AND GRADIENT 


OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 


ooeeee eee 


X( 1)= 0.90000000E 00 


X( 2)= 
X( 3)= 
4 


X( 5)= 
X( 6)= 
X( 7)= 
0.2011E 
0.1843E 
0.9440E 
0.9437E 
0.2332E 
0.1010E 


0.7646E- 
0.4707E- 
0.3230E- 
0.2245E- 
0.2088E- 
0.1844E- 
0.1840E- 
0.1840E- 
0.1299E- 
0.1226E- 
0 .8329E- 
0.3661E- 
0.3357E- 
0.3193E- 
0.2968E-' 
0.2671E- 
0.2317E- 
0.2179E- 
0.1915E- 
0.1560E- 
0.1333E- 
0.1188E- 


F= 0.11195E-02 


NO OF FUNCT 


OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDP 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 


0.95000001E 
0.40000000E 
0 .80000000E 
0.60000000E 
0.80000000E 
0.92072797E. 
01 


01 
01 
‘01 
01 
01 
01 
01 
01 
01 
01 
02 
02 
02 
02 
02 
02 
02 
02 
02 
02 
02 
02 


IER= 1 


00 
00 


00 
01 

ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 


NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 


1)=-0.48376090E 00 
2)=-0.21596835E 00 
3)=-0.14348531E 01 
4)= 0.44140776E 01 
5)=-0.41605789E 01 
6)=-0.15939708E 01 
7)= 0.85156908E-06 


27 
28 


NO OF ITERATIONS= 28 


EVALUATIONS= 135 


X( 1)= 0.94482371E 00 


X( 2)= 
X( 3)= 
X( 4)= 
X( 5)= 
x( 6) 
x( 7 


0.1120E-' 
0.1116E- 
0.1114E-1 
0.1040E- 
0.1023E- 
0.9362E- 
0.8319E- 
0. 7426E- 
0 .6654E-| 
0.6060E- 
0.4856E- 
0.3706E- 
0.3171E- 
0.2556E- 
0.2345E- 
0.2041E- 
0.1728E-| 
0.1621E- 


0 .97314056E 
0.72813510E 
0.43455667E 
0.76811282E 
0 .87526403E 
0.33795486E 
02 
02 
02 
02 
02 
03 
03 
03 
03 
03 
03 
03 
03 
03 
03 
03 
03 
03 


00 

00 

00 

00 

00 

00 

ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 


6.2-7 


1)= 0.86673560E-02 
2)= 0.36474567E-02 
3)= 0.85005024E-02 
4)= 0.71129587E-02 
5) =-0.50341815E-02 
6)= 0.14805895E-01 
7)=-0.11955116E-01 


COBYHHBwWNK= 


LPIIR 


IIR Programs 


Table 3 
(Continued) 

OLDF = 0.1555E-03 ITERATION NO. 19 

OLDF = 0.1466E-03 ITERATION NO. 20 

OLDF = 0,1423E-03 ITERATION NO. 21 

OLDF = 0.1392E-03 ITERATION NO. 22 

OLDF = 0.1375E-03 ITERATION NO. 23 

OLDF = 0.1369E-03 ITERATION NO. 24 

OLDF = 0.1367E-03 ITERATION NO. 25 

OLDF = 0.1366E-03 ITERATION NO. 26 

OLDF = 0.1366E-03 ITERATION NO. 27 

OLDF = 0.1366E-03 ITERATION NO. 28 

F= 0.13661E-03 IER= 0 NO OF ITERATIONS= 28 

NO OF FUNCT EVALUATIONS= 246 
X( 1)= 0.85934433E 00 G( 1)=-0.12731826E-04 
X( 2)= 0.93765157E 00 G( 2)= 0,.46204799E-04 
X( 3)= 0.80925703E 00 G( 3)= 0.62992023E-04 
X( 4)= 0.51230380E 00 G( 4)= 0.12864991E-04 
X( 5)= 0.78067586E 00 G( 5)=-0.11647338E-04 
X( 6)= 0.88864766E 00 G( 6) =-0.43512307E-04 
X(7)= 0.44070618E 00 G(_ 7)=-0.42195573E-04 


SYNTHESIS OF DIGITAL FILTER WITH SPEC. MAGNITUDE AND/OR GROUP DELAY 

THE ERROR CRITERION USED IS MINIMUM 2 FOR THE MAGNITUDE AND 
MINIMUM 0 FOR THE GROUP DELAY 

F= 0.13661E-03 IER= 0 NO OF ITERATIONS= 56 


NO OF FUNCT EVALUATIONS= 246 


COMPUTED ARG. VECTOR AND GRADIENT 


X( 1)= 0.85934433E 00 G( 1)=-0.12731826E-04 
X( 2)= 0.93765157E 00 G( 2)= 0.46204799E-04 
X( 3)= 0.80925703E 00 G( 3)= 0.62992023E-04 
X( 4)= 0.51230380E 00 G( 4)= 0.12864991E-04 
X( 5)= 0.78067586E 00 G( 5)=-0.11647338E-04 
X( 6)= 0.88864766E 00 G( 6)=-0.43512307E-04 


X( 7)= 0.44070618E 00 G( 7)=-0.42195573E-04 


Z PLANE ZEROS 


ANGLE/2PI+«FS RADIUS 
0.34373773E 01 0.10000000E 01 
0.37506063E 01 0.10000000E 01 


Z PLANE POLES 


ANGLE/2PI+FS RADIUS 
0.32370281E 01 0.51230380E 00 
0.31227034E 01 0.88864766E 00 


CONST= 0.44070618E 00 


NUMERATOR COEFFICIENTS 


AO Al A2 
0.10000000E 01 0.18078962E 01 0.10000000E 01 
0.10000000E 01 0.19617561E 01 0.10000000E 01 


DENOMINATOR COEFFICIENTS 


6.2-8 


Chapter 6 


Section 6.2 LPUR 


Table 3 
(Continued) 
BO BI B2 

0.10000000E 01 0.84608650E 00 0.26245519E 00 

0.10000000E 01 0.13718319E 01 0.78969466E 00 
FREQUENCY RESPONSE 
FREQUENCY MAGNITUDE LOSS IN DB PHASE GROUP DELAY 
0 0.99734E 00 0.23141E-01 0 0.41631E 00 


0.1000E 00 0.99736E 00 0.22927E-01 -0.32716E-01 0.41705E 00 
0.2000E 00 0.99744E 00 0.22285E-01 -0.65548E-01 0.41927E 00- 
0.3000E 00 0.99756E 00 0.21217E-01 -0.98614E-01 0.42301E 00 
0.4000E 00 0.99773E 00 0.19725E-01 -0.13204E 00 0.42832E 00 
0.5000E 00 0.99795E 00 0.17812E-01 -0.16594E 00 0,43528E 00 
0.6000E 00 0.99822E 00 0.15486E-01 -0.20046E 00 0.44399E 00 
0.7000E 00 0.99853E 00 0.12756E-01 -0.23573E 00 0.45460E 00 
0.8000E 00 0.99889E 00 0 .96374E-02 -0.27192E 00 0.46726E 00 
0.9000E 00 0.99929E 00 0.61515E-02 -0.30919E 00 0.48219E 00 
0.1000E 01 0.99973E 00 0.23305E-02 -0.34772E 00 0.49964E 00 
0.1100E 01 0.10002E 01 -0.17812E-02 -0.38774E 00 0.51992E 00 
0.1200E 01 0.10007E 01 -0.61210E-02 -0.42948E 00 0.54342E 00 
0.1300E 01 0.10012E 01 -0.10604E-01 -0.47320E 00 0.57060E 00 
0.1400E 01 0.10017E 01 -0.15111E-01 -0.51922E 00 0.60204E 00 
0.1500E 01 0.10022E 01 -0.19485E-01 -0.56790E 00 0.63843E 00 
0.1600E 01 0.10027E 01 -0.23515E-01 -0.61966E 00 0.68065E 00 
0.1700E 01 0.10031E 01 -0.26921E-01 -0.67499E 00 0.72979E 00 
0.1800E 01 0.10034E 01 -0.29345E-01 -0.73451E 00 0.78722E 00 
0.1900E 01 0.10035E 01 -0.30329E-01 -0.79891E 00 0.85469E 00 
0.2000E 01 0.10034E 01 -0.29314E-01 -0.86908E 00 0.93449E 00 
0.2100E 01 0.10030E 01 -0.25655E-01 -0.94610E 00 0.10296E 01 
0.2200E 01 0.10022E 01 -0.18691E-01 -0.10313E 01 0.11443E 01 
0.2300E 01 0.10009E 01 -0.79214E-02 -0.11265E 01 0.12844E 01 
0.2400E 01 0.99924E 00 0.65813E-02 -0.12340E 01 0.14591E 01 
0.2500E 01 0.99732E 00 0.23335E-01 -0.13570E 01 0.16834E 01 
0.2600E 01 0.99565E 00 0.37861E-01 -0.15004E 01 0.19846E 01 
0.2700E 01 0.99538E 00 0.40248E-01 0.14694E 01 0.24188E 01 
0.2800E 01 0.99836E 00 0.14274E-01 0.12546E 01 0.31137E 01 
0.2900E 01 0.10048E 01 -0.41574E-01 0.96552E 00 0.43889E 01 
0.3000E 01 0.99246E 00 0.65750E-01 0.53160E 00 0.69448E 01 
0.3100E 01 0.82696E 00 0.16503E 01 -0.15353E 00 0.10246E 02 
0.3200E 01 0.42377E 00 0.74575E 01 -0.93579E 00 0.87367E 01 
0.3300E 01 0.13648E 00 0.17299E 02 -0.14902E 01 0.56188E 01 
0.3400E 01 0.19414E-01 0.34238E 02 0.12814E 01 0.40069E 01 
0.3500E 01 0.16017E-01 0.35909E 02 0.10007E 01 0.32261E 01 
0.3600E 01 0.17455E-01 0.35162E 02 0.76557E 00 0.28006E 01 
0.3700E 01 0.65969E-02 0.43613E 02 0.55644E 00 0.25453E 01 
0.3800E 01 0 .60683E-02 0.44339E 02 0.36320E 00 0.23889E 01 
0.3900E 01 0.15293E-01 0.36310E 02 0.17938E 00 0.23024E 01 
0.4000E 01 0.18610E-01 0.34605E 02 0 .45134E-08 0.22747E 01 
COEFFICIENTS OF DIGITAL FILTER WITH SPEC. AMPLITUDE AND/OR GROUP DELAY 
N= 2 

0.4407062E 00 2 

0.1000000E 01 0.1807896E 01 0.1000000E 01 0.8460865E 00 0.2624552E 00 

0.1000000E 01 0.1961756E 01 0.1000000E 01 0.1371832E 01 0.7896947E 00 


6.2-9 


IIR Programs 


Moocow 


eoNONO+0-00 
CHUBOMUBROOUN 


0.4054801E+00 
0.1000000E+01 0.1808052E+01 0.1000000E+01 0.7221175E+00 0,2360188E+00 
0.1000000E+01 0.1963544E+01 0.1000000E+01 0.1344155E+01 0.8002729E+00 


2 


TO = 0,23540250E 02 


F= 0.46328E 01 


IER= 0 


NO OF FUNCT EVALUATIONS= 


Table 4 


Table 5 


NO OF ITERATIONS= 0 


INITIAL ARG. VECTOR AND GRADIENT 


OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDP 


X( 1)= 0.12500000E 


x( 
x( 


2)= 
3)= 
4)= 
5)= 
6)= 


0.1453E 
0.1027E 
0.9522E 
0.9090E 
0.8530E 
0.8498E 
0.8458E 
0.8437E 
0.8253E 
0.7907E 


0 .80000000E 
0.25000000E 
0 .80000000E 
0.37500000E 
0.80000000E 
0.50000000E 
0.80000000E 
0.62500000E 
0.80000000E 
0.23540250E 
01 
01 
01 
00 
00 
00 
00 
00 
00 
00 
00 


00 
00 
00 
00 


ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 


6.2-10 


G(1 

61 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 1 


1)= 0.65278458E 
2)= 0.41243368E 
3)= 0.22710607E 
4)= 0.12409674E 
5)= 0.55761530E 
6)= 0.13062503E 
7)=-0.14036452E 


)= 0.15493840E 
9)=-0.68205060E 
0)= 0,.45851613E 
1)= 0.10770746E- 
1 
2 
3 
4 
5 
6 
Kf 
8 
9 
0 
1 


02 
01 
02 
02 
01 
02 
02 
02 
02 
01 
05 


Chapter 6 


Section 6.2 


OLDF 0.7892E 00 
OLDF 0.7771E. 00 
OLDF = 0.7758E 00 
OLDF = 0.7757E 00 
F= 0.77572E 00 IER= 
NO OF FUNCT EVALUATIONS= 


X( 1)= 
X( 2)= 


x(11)= 


SYNTHESIS OF DIGITAL FILTER 


THE ERROR CRITERION USED IS 


P= 0.77572E 00 


IER= 


NO OF FUNCT EVALUATIONS= 


60 


0.69931745E-01 
0.74191473E 00 
0.21490648E 00 
0.74735180E 00 
0.35960912E 00 
0.75370811E 00 
0.50457408E 00 
0.76478518E 00 
0.65060432E 00 
0.78936825E 00 
0.23742240E 02 


Table 5 
(Continued) 


ITERATION NO. 12 
ITERATION NO. 13 
ITERATION NO. 14 
ITERATION NO. 15 


NO OF ITERATIONS= 15 


G( 1)=-0.10378439E-02 
G( 2)=-0.57872886E-03 
G( 3)= 0.18699270E-02 
G( 4)=-0.32778834E-03 
G( 5)=-0.15411069E-02 
G( 6)= 0.70288699E-03 
G( 7)=-0.82738208E-03 
G( 8)= 0.10225077E-02 
G( 9)= 0.92509451E-03 
G(10) =-0.72606624E-03 
G(11)= 0.63875690E-04 


WITH SPEC. MAGNITUDE AND/OR GROUP 


MINIMUM 0 FOR THE MAGNITUDE AND 


MINIMUM 2 FOR THE GROUP DELAY 


NO OF ITERATIONS= 15 


60 


COMPUTED ARG. VECTOR AND GRADIENT 


X(_ 1)= 0.69931745E-01 


X( 2)= 
X( 3)= 
X( 4)= 


Zz 


ANGLE/2PI«FS 


0.27972698E 
0.85962593E 
0.14384365E 
0.20182963E 
0.26024173E 


00 
00 
01 
01 
01 


Zz 


ANGLE/2PI+*FS 


0.27972698E 
0.85962593E 
0.14384365E 
0.20182963E 
0.26024173E 


CONST= 0.25809068E-01 


00 
00 
01 
01 
01 


0.74191473E 00 
0.21490648E 00 
0.74735180E 00 
0.35960912E 00 
0.75370811E 00 
0.50457408E 00 
0.76478518E 00 
0.65060432E 00 
0.78936825E 00 
0.23742240E 02 


PLANE 


PLANE 


ZEROS 


G( 1) =-0.10378439E-02 
G( 2)=-0.57872886E-03 
G( 3)= 0.18699270E-02 
G( 4) =-0.32778834E-03 
G( 5)=-0.15411069E-02 
G( 6)= 0.70288699E-03 
G( 7)=-0,.82738208E-03 
G( 8)= 0.10225077E-02 
G( 9)= 0.92509451E-03 
G(10) =-0.72606624E-03 
G(11)= 0.63875690E-04 


RADIUS 


0.13478638E 01 
0.13380579E 01 
0.13267736E 01 
0.13075567E 01 
0.12668359E 01 


POLES 


RADIUS 


0.74191473E 00 
0.74735180E 00 
0.75370811E 00 
0.76478518E 00 
0.78936825E 00 


NUMERATOR COEFFICIENTS 


6.2-11 


DELAY 


LPIIR 


TIR Programs 


FREQUEN! 
FREQUEN 


oO. 

0.1000E 
0.2000E 
0.3000E 
0.4000E 
0.5000E 
0.6000E 
0.7000E 
0.8000E 
0.9000E 
0.1000E 
0.1100E 
0.1200E 
0.1300E 
0.1400E 
0.1500E 
0,1600E 
0.1700E 
0.1800E 
0.1900E 
0.2000E 
0.2100E 
0.2200E 
0.2300E 
0.2400E 
0.2500E 
0.2600E 
0.2700E 
0.2800E 
0.2900E 
0.3000E 
0.3100E 
0.3200E 
0.3300E 
0.3400E 
0.3500E 
0.360CE 
0.3700E 
0.3800E 
0.3900E 
0.4000E 


AO 


0.10000000E 01 
0.10000000E 01 
0.10000000E 01 
0.10000000E 01 
0.10000000E 01 
0.10000000E 01 
0.10000000E 01 


Table 5 
(Continued) 


Al 


-0.26309318E 01 
+20890137E 01 
-0.11327730E 01 
0.37577558E-01 
0.11545468E 01 
0.18080520E 01 
0.19635440E 01 


o. 
oO. 
oO. 
oO. 
0. 
oO. 
0. 


DENOMINATOR COEFFICIENTS 


BO 


0.10000000E 01 
0.10000000E 01 
0.10000000E 01 
0.10000000E 01 
0.10000000E 01 
0.10000000E 01 
0.10000000E 01 


ICY RESPONSE 
icy MAGNITUDE 
0.99397E 00 


00 0.99402E 00 
00 0.99418E 00 
00 0.99445E 00 
00 0.99483E 00 
00 0.99532E 00 
00 0.99591E 00 
00 0.99661E 00 
00 0.99740E 00 
00 0.99830E 00 
01 0.99928E 00 
01 0.10003E 01 
01 0.10015E 01 
01 0.10026E 01 
01 0.10038E 01 
01 0.10050E 01 
01 0.10060E 01 
01 0.10069E 01 
01 0.10076E 01 
01 0.10079E 01 
01 0.10077E 01 
01 0.10068E 01 
01 0.10050E 01 
01 0.10023E 01 
01 0.99857E 00 
01 0.99424E 00 
01 0.99038E 00 
01 0.98939E 00 
01 0.99536E 00 
01 0.10098E 01 
01 0.98849E 00 
01 0.72063E 00 
01 0.31031E 00 
01 0.95332E-01 
01 0.13550E-01 
01 0.11106E-01 
01 0.12283E-01 
01 0.49781E-02 
01 0.35983E-02 
01 0.98545E-02 
01 0.12105E-01 


Bi 


-0.14481634E 01 
-0.11667867E 01 
-0.64350106E 00 
0.21978977E-01 
0.71940067E 00 
0.72211750E 00 
0.13441550E 01 


LOSS IN DB 


0.52569E-01 
0.52095E-01 
0.50674E-01 
0.48308E-01 
0.45000E-01 
0.40758E-01 
0.35593E-01 
0.29525E-01 
0 .22582E-01 
0.14809E-01 
0 .62713E-02 
-0.29378E-02 
-0.12684E-01 
-0.22783E-01 
-0.32979E-01 
-0.42924E-01 
-0.52152E-01 
-0.60041E-01 
-0.65785E-01 
-0.68356E-01 
-0.66493E-01 
-0.58735E-01 
-0.43571E-01 
-0.19834E-01 
0.12424E-01 
0.50145E-01 
0.83919E-01 
0.92664E-01 
0.40426E-01 
-0.84676E-01 
0.10056E 00 
0.28458E 01 
0.10164E 02 
0.20415E 02 
0,.37361E 02 
0.39089E 02 
0.38214E 02 
0.46059E 02 
0.48878E 02 
0.40127E 02 
0.38341E 02 


6.2-12 


0. 
o. 
oO. 
0. 
0. 
0. 
0. 


PHASE 


Oo. 
-0.10481E 
0.10184E 


-0.79897E- 


-0.11673E 
0.92243E 
-0.10632E 
-0.11475E 
0.91600E 
-0.18501E 
-0.12679E 
0.82968E 
-0.19654E 
-0.12446E 
0.80726E 
-0.29869E 
-0.13748E 
0.73341E 
-0.28978E 
-0.13479E 
0.68727E 
-0.42571E 
-0.14914E 
0.63383E 
-0.38315E 
-0.14591E 
0,.54186E 
-0.58274E 
0,15298E 
0.57264E 
-0.44639E 
0.15006E 
0.45139E 
-0.28369E 
-0.84098E 
-0.13067E 
0.14220E 
0.10425E 
0.68428E 
0.33906E 


0.85404E- 


Chapter 6 


A2 


18167368E 01 
17903990E 01 
17603281E 01 
17097046E 01 
16048731E 01 
10000000E 01 
10000000E 01 


B2 


55043747E 00 
55853470E 00 
56807592E 00 
58489637E 00 
62310224E 00 
23601880E 00 
80027290E 00 


GROUP DELAY 


0.13272E 02 
01 0.13483E 02 
01 0.13887E 02 
01 0.13997E 02 
01 0.13634E 02 
00 0.13182E 02 
00 0.13098E 02 
01 0.13474E 02 
00 0.13948E 02 
00 0.13989E 02 
01 0.13537E 02 
00 0.13100E 02 
00 0.13126E 02 
01 0,.13612E 02 
00 0.14078E 02 
00 0.13972E 02 
01 0.13401E 02 
00 0.12992E 02 
00 0.13169E 02 
01 0.13811E 02 
00 0.14265E 02 
00 0.13945E 02 
01 0.13190E 02 
00 0.12807E 02 
00 0,13227E 02 
01 0.14197E 02 
00 0.14653E 02 
00 0.13789E 02 
01 0.12469E 02 
00 0.12194E 02 
00 0.14160E 02 
o1 0.15321E 02 
00 0.11112E 02 
00 0.79653E 01 
00 0.63978E 01 
01 0.55386E 01 
01 0.50138E 01 
01 0.46763E 01 
00 0.44624E 01 
00 0.43428E 01 
08 0.43042E 01 


Section 6.2 


Table 5 
(Continued) 


COEFFICIENTS OF DIGITAL FILTER WITH SPEC. AMPLITUDE AND/OR GROUP DELAY 
N= 7 

0.2580907E-01 ¥ 

0.1000000E 01-0. 2630932E 01 0.1816737E 01-0.1448163E 01 0.5504375E 00 
0.1000000E 01-0.2089014E 01 0.1790399E 01-0.1166787E 01 0.5585347E 00 
0.1000000E 01-0.1132773E 01 0.1760328E 01-0.6435011E 00 0.5680759E 00 
0.1000000E 01 0.3757756E-01 0.1709705E 01 0.2197898E-01 0.5848964E 00 
0.1000000E 01 0.1154547E 01 0.1604873E 01 0.7194007E 00 0.6231022E 00 
0.1000000E 01 0.1808052E 01 0.1000000E 01 0.7221175E 00 0.2360188E 00 
0.1000000E 01 0.1963544E 01 0.1000000E 01 0.1344155E 01 0.8002729E 00 


Table 6 


eonoon= 


C FUNCTION: FS 
C FUNCTION FOR SPECIFYING THE REQUIRED MAGNITUDE 


C= 
c 
FUNCTION FS(FI) 
COMMON /CM40/ FIK(10), NPK(10), NK 
COMMON /UNIT/ IND, INP, IOUTD, IOUTP, PI, SPM 
c 
c 
IF (FI.LT.FIK(K1) .OR. FI.GE.FIK(K)) GO TO 60 
c 
GO TO (10, 20, 30, 40, 50), K1 
10 FPS = FI 
GO TO 60 
20 FS = 0.0 
GO TO 60 


6.2-13 


IIR Programs 


30 
40 


50 
60 


KO = 


) 


0.73584E-03 


Table 7 
(Continued) 


Table 8 


-40636079E 00 


IER= 0 


OF FUNCT EVALUATIONS= 2 


NO OF ITERATIONS= 0 


INITIAL ARG. VECTOR AND GRADIENT 


X( 1)= 0.10000000E 
x( 2)= 0. 

X( 3)= 0.40000000E 
X( 4)=-0.40000000E 


X( 5)= 0.40636079E 

OLDF = 0.7358E-03 

OLDF = 0.6962E-03 

OLDF = 0.5559E-03 

OLDF = 0.3074E-03 

OLDF = 0.2654E-03 

OLDF = 0.2616E-03 

OLDF = 0.2614E-03 

OLDF = 0.2613E-03 

OLDF = 0.2612E-03 

OLDF = 0.2276E-03 

OLDF = 0.2251E-03 

OLDF = 0.2057E-03 

OLDF = 0.2056E-03 

OLDF = 0.2029E-03 

OLDF = 0.1928E-03 

OLDF = 0.1618E-03 

OLDF = 0.1610E-03 

OLDF = 0.1605E-03 

OLDF = 0.1341E-03 

OLDF = 0.1180E-03 

F= 0.99983E-04 IER= 1 

NO OF FUNCT EVALUATIONS= 87 
X( 1)= 0.93417000E 
X( 2)=-0.37288283E 
X( 3)=-0.32908125E- 
X( 4)=-0.50697450E 
X( 5)= 0.38296990E 

OLDF = 0.9998E-04 

OLDF = 0.9836E-04 

OLDF = 0.9728E-04 

OLDF = 0.7447E-04 

OLDF = 0.7266E-04 

OLDF = 0.7207E-04 

OLDF = 0.6405E-04 

OLDF = 0.6369E-04 

OLDF = 0.6308E-04 

OLDF = 0.5820E-04 

OLDF = 0.3910E-04 

OLDF = 0.2897E-04 

OLDF = 0.2036E-04 

OLDF = 0.1656E-04 

OLDF = 0.1597E-04 

OLDF = 0.1592E-04 

OLDF = 0.1591E-04 


01 


00 

00 

00 

ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 


NO. 
NO. 


1)=-0,89594565E-08 
2) =-0.83907518E-02 
3)= 0.71825904E-02 
4)= 0.93726298E-02 
5)=-0.44460990E-07 


19 
20 


NO OF ITERATIONS= 20 


00 

00 

01 

00 

00 

ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 


6.2-14 


1)=-0.11521710E-02 
0 .22680329E-02 
3)= 0.16926230E-02 
4)= 0.32463408E-02 
5)=-0.35211345E-02 


Chapter 6 


Section 6.2 


Table 8 
(Continued) 


F= 0.15910E-04 IER= 0 


NO OF FUNCT EVALUATIONS= 151 


X( 1)= 0.10000424E 01 


X( 2)=-0.67870385E 00 
X( 3)=-0.14765522E 00 


X( 4)=-0.72136589E 00 


X( 5)= 0.36585334E 00 
ITERATION NO. 1 
ITERATION NO. 2 
ITERATION NO. 3 


OLDF = 0.6192E-09 
OLDF = 0.6140E-09 
OLDF = 0,.6140E-09 


F= 0.61399E-09 IER=-1 


NO OF FUNCT EVALUATIONS= 159 

X( 1)= 0.10000470E 01 
X( 2)=-0.67867164E 00 
X( 3)=-0.14766660E 00 
X( 4)=-0.72140586E 00 
X( 5)= 0.36587823E 00 


OLDF = 0.6140E-09 
OLDF = 0.6140E-09 
OLDF = 0.6140E-09 
OLDF = 0.6140E-09 


F= 0.61399E-09 IER=-1 


NO OF FUNCT EVALUATIONS= 169 

X( 1)= 0.10000470E 01 
X( 2)=-0.67867164E 00 
X( 3)=-0.14766659E 00 
X( 4)=-0.72140592E 00 
X( 5)= 0.36587815E 00 


OLDF = 0.6140E-09 
OLDF = 0.6140E-09 
OLDF = 0.6140E-09 
OLDF = 0.6140E-09 


F= 0.61399E-09 IER=-1 


NO OF FUNCT EVALUATIONS= 180 

X( 1)= 0.10000470E 01 
X( 2)=-0.67867164E 00 
X( 3)=-0.14766657E 00 
X( 4)=-0.72140595E 00 
X( 5)= 0,36587810E 00 


NO OF ITERATIONS= 17 


G( 1)= 0.30941774E-06 


0.67787406E-05 
0.22261859E-05 
0 .75488852E-05 


G( 5)= 0.96522615E-06 


NO OF ITERATIONS= 3 


G( 1)= 0.39802203E-08 
G( 2) =-0.21001670E-08 
G( 3)=-0.58512773E-08 
G( 4)= 0.14038922E-07 
G( 5)= 0.21759798E-07 


ITERATION NO. 1 
ITERATION NO. 2 
ITERATION NO. 3 
ITERATION NO. 4 


NO OF ITERATIONS= 4 


G( 1)= 0.39722658E-08 
G( 2)=-0.21268438E-08 
G( 3)=-0.58366352E-08 
G( 4)= 0.14067840E-07 
G( 5)= 0.21716322E-07 


ITERATION NO. 1 
ITERATION NO. 2 
ITERATION NO. 3 
ITERATION NO. 4 


NO OF ITERATIONS= 4 


G( 1)= 0,39662328E-08 
G( 2)=-0.21494927E-08 
G( 3)=-0,58250289E-08 
G( 4)= 0.14092620E-07 
G( 5)= 0.21683346E-07 


SYNTHESIS OF DIGITAL FILTER WITH SPEC. MAGNITUDE AND/OR GROUP 


THE ERROR CRITERION USED IS MINIMUM 4 FOR THE MAGNITUDE AND 


MINIMUM 0 FOR THE GROUP DELAY 


F= 0.61399E-09 IER=-1 


NO OF FUNCT EVALUATIONS= 180 


NO OF ITERATIONS= 48 


COMPUTED ARG. VECTOR AND GRADIENT 


X( 1)= 0.10000470E 01 
X( 2)=-0.67867164E 00 
X( 3)=-0.14766657E 00 
X( 4)=-0.72140595E 00 
X( 5)= 0.36587810E 00 


G( 1)= 0.39662328E-08 
G( 2)=-0.21494927E-08 
G( 3)=-0.58250289E-08 
G( 4)= 0.14092620E-07 
G( 5)= 0.21683346E-07 


Z PLANE ZEROS 
6.2-15 


DELAY 


LPIIR 


IIR Programs 


CONST= 


FREQUEN 
FREQUEN! 


0. 

0.2000E- 
0.40005 
0. 6000E- 
0.8000E 
0.1000E 
0.1200E 
0.1400E 
0.1600E 
0.1800E 
0.2000E 
0.2200E 
0.2400E 
0.2600E 
0.2800E 
0.3000E 
0.3200E 
0.3400E 
0.3600E 
0.3800E 
0.4000E 
0.4200E 
0,4400E 
0.4600E 
0.4800E 
0.5000E 
0.5200E 
0,5400E 
0.5600E 
0.5800E 
0.6000E 
0.6200E 
0.6400E 
0.6600E 
0.6800E 


Table 8 
(Continued) 


ANGLE/2PI*FS 


0. 
0. 


RADIUS 


0.10000470E 01 
-0.67867164E 00 


Z PLANE POLES 


ANGLE/ 2PI*FS 


0. 
0. 


AO 


0.10000000E 01 
0.10000000E 01 


BO 


0.10000000E 01 
0.10000000E 01 


0.36587810E 00 


RADIUS 


-0.14766657E 00 
-0.72140595E 00 


NUMERATOR COEFFICIENTS 


DENOMINATOR COEFFICIENTS 


ICY RESPONSE 
icy MAGNITUDE 
0.14602E-04 
-01 0.19535E-01 
-01 0.39078E-01 
-01 0.58635E-01 
-01 0.76213E-01 
00 0.97820E-01 
00 0.11746E 00 
00 0. 13715E 00 
00 0.15688E 00 
00 0.17666E 00 
00 0.19650E 00 
00 0.21641E 00 
00 0.23638E 00 
00 0, 25642E 00 
00 © ©—0.27653E 00 
00 0,29671E 00 
00 ©=—-0.31697E 00 
00 0. 33729E 00 
00 ©0.35768E 00 
00 0.37814E 00 
00 0.39865E 00 
00 0.41921E 00 
00 0.43982E 00 
00 0.46044E 00 
00 0.48108E 00 
oo 0.50172E 00 
00 0.52233E 00 
00 0.54290E 00 
00 0.56340E 00 
00 ©=—-0.58381E 00 
00 0.60410E 00 
00 ©=-0.62424E 00 
00 0.64421E 00 
00 0.66399E 00 
00 0.68355E 00 


Al 


-0.10000470E 01 
0.67867164E 00 


BI 


0.14766657E 00 
0.72140595E 00 


LOSS IN DB 


0.96712E 02 
0.34184E 02 
0.28161E 02 
0.24637E 02 
0.22134E 02 
0.20191E 02 
0.18602E 02 
0.17256E 02 
0.16089E 02 
0.15057E 02 
0.14133E 02 
0.13295E 02 
0.12528E 02 
0.11821E 02 
0.11165E 02 
0.10553E 02 
0.99797E 01 
0.94399E 01 
0.89300E 01 
0.84469E 01 
0.79881E 01 
0.75513E 01 
0.71346E 01 
0.67365E 01 
0.63556E 01 
0.59908E 01 
0.56411E 01 
0.53056E 01 
0.49837E 01 
0.46746E 01 
0.43779E 01 
0.40930E 01 
0.38194E 01 
0.35568E 01 
0.33046E 01 


6.2-16 


0 


A2 


B2 


PHASE 


0.15491E 01 


0.15263E 01 
0.15038E 01 
0.14812E 01 
0.14585E 01 
0.14358E 01 
0.14130E 01 
0.13900E 01 
0.13669E 01 
0.13437E 01 
0.13202E 01 
0.12965E 01 
0.12726E 01 
0.12485E 01 
0.12240E 01 
0.11993E 01 
0.11743E 01 
0.11489E 01 
0.11232E 01 
0.10972E 01 
0.10707E 01 
0.10438E 01 
0.10166E 01 
0.98887E 00 
0.96071E 00 
0.93209E 00 
0.90301E 00 
0.87345E 00 
0.84340E 00 
0.81288E 00 
0.78186E 00 
0.75037E 00 
0.71842E 00 
0.68600E 00 


Chapter 6 


GROUP DELAY 


0.85654E 
0.36860E 
0.36013E 
0.35923E 
0.35971E 
0.36081E 
0.36233E 
0.36422E 
0.36645E 
0.36900E 
0.37188E 
0.37508E 
0.37859E 
0.38242E 
0.38657E 
0.39103E 
0.39580E 
0.40088E 
0.40627E 
0.41196E 
0.41794E 
0.42420E 
0.43073E 
0.43751E 
0.44452E 
0.451745 
0.45914E 
0.46668E 
0.47432E 
0.48202E 
0.48973E 
0.49738E 
0.50493E 
0,51230E 
0.51945E 


Section 6.2 


0.7000E 
0.7200E 
0.7400E 
0.7600E 
0.7800E 
0.8000E 
0.8200E 
0.8400E 
0.8600E 
0.8800E 
0.9000E 
0.9200E 
0.9400E 
0.9600E 
0.9800E 
0.1000E 


0.70288E 
0.72199E 
0.74089E 
0.75961E 
0.77823E 
0.79687E 
0.81570E 
0.83496E 
0.85494E 
0.87600E 
0.89838E 
0.92202E 
0.94603E 
0.96807E 
0.98422E 
0.99025E 


00 


Table 8 
(Continued) 


0.30623E 
0.28294E 
0.26050E 
0.23882E 
0.21778E 
0.19722E 
0.17694E 
0.15667E 
0.13613E 
0.11499E 
0.93078E 
0.70517E 
0.48194E 
0.28187E 
0.13812E 
0.85114E- 


01 
01 
01 
01 


01 


0.65315E 
0.61987E 
0.58618E 
0.55209E 
0.51761E 
0 .48268E 
0.44723E 
0.41107E 
0.37386E 
0.33498E 
0.29348E 
0.24793E 
0.19653E 
0.13773E 


0.71360E- 
0.22831E- 


oo 
01 
08 


0.52634E 
0.53294E 
0.53932E 
0.54563E 
0.55220E 
0.55967E 
0.56919E 
0.58272E 
0.60349E 
0 .63643E 
0.68835E 
0.76656E 
0.87389E 
0.99885E 
0.11068E 
0.11506E 


01 


COEFFICIENTS OF DIGITAL FILTER WITH SPEC. AMPLITUDE AND/OR GROUP DELAY 


N= 2 


0.3658781E 00 


2 


0.1000000E 01-0.1000047E 01 0. 
0.1000000E 01 0.6786716E 00 0. 


RVENOCON 


Table 9 


6.2-17 


0.1476666E 00 0. 
0.7214059E 00 0. 


LPHR 


TIR Programs 


Table 10 


Chapter 6 


C FUNCTION: DGS 
C FUNCTION FOR SPECIFYING THE REQUIRED GROUP DELAY 


10 
20 
30 
40 


50 
60 


FUNCTION DGS(FI) 
COMMON /CM40/ FIK(10), NPK(10), NK 


COMMON /UNIT/ IND, INP, IOUTD, 


DO 60 K=2,NK 


K1 =K - 


1 


IouTP, 


PI, 


SPM 


IF (PI.LT.FIK(K1) .OR. FI.GE.FIK(K)) GO TO 60 


GO TO (10 
GO TO 60 


CONTINUE 
RETURN 
END 


» 20, 
DGS = 15.0«FI 


30, 40, 50), K1 


Table 11 


TO = 0.79225496E 01 


F= 0.50424E 


02 


IER= 0 


NO OF FUNCT EVALUATIONS= 


NO OF ITERATIONS= 0 


INITIAL ARG. VECTOR AND GRADIENT 

X( 1)= 0.28000000E 00 

X( 2)= 0.83000000E 00 

X( 3)= 0.49000000E 00 

X( 4)= 0.86000000E 00 

X( 5)= 0.68000000E 00 

X( 6)= 0.89000000E 00 

X(_ 7)= 0.78000000E 00 

X( 8)= 0.93000000E 00 

X( 9)= 0.79225496E 01 
OLDF = 0.5042E 02 ITERATION 
OLDF = 0.1331E 02 ITERATION 
OLDF = 0.6873E 01 ITERATION 
OLDF = 0.1406E 01 ITERATION 
OLDF = 0.5441E 00 ITERATION 
OLDF = 0.2941E 00 ITERATION 
OLDF = 0.2792E 00 ITERATION 
OLDF = 0.1421E 00 ITERATION 
OLDF = 0.8885E-01 ITERATION 
OLDF = 0.8829E-01 ITERATION 
OLDF = 0.7818E-01 ITERATION 
OLDF = 0.6680E-01 ITERATION 
OLDF = 0.6096E-01 ITERATION 
OLDF = 0.5107E-01 ITERATION 
OLDF = 0.4558E-01 ITERATION 
OLDF = 0.4314E-01 ITERATION 
OLDF = 0.3764E-01 ITERATION 
OLDF = 0.3505E-01 ITERATION 
OLDF = 0.3377E-01 ITERATION 
OLDF = 0.3310E-01 ITERATION 
OLDF = 0.3286E-01 ITERATION 
OLDF = 0.3268E-01 ITERATION 
OLDF = 0.3263E-01 ITERATION 
OLDF = 0.3260E-01 ITERATION 


6.2-18 


1)=-0.36053095E 01 
2)= 0.39729306E 02 
3)=-0.27526696E 02 
4)= 0.52982008E 02 
5)= 0.87300517E 02 
6)= 0.11213860E 03 
7)=-0.34945496E 03 
8)= 0.54749140E 03 
9)= 0.12665987E-06 


1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 


18 
19 
20 
21 


« 22 


23 
24 


Section 6.2 


OLDF 
OLDF 
OLDP 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 


F= 0.27454E-01 


NO OF FUNCT 


OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 
OLDF 


F= 0.27449E-01 


NO OF FUNCT EVALUATIONS= 176 
X( 1)= 0.41735033E 
X( 2)= 0.57608889E 
X( 3)= 0.62094770E 
X( 4)= 0.63927549E 
X( 5)= 0.10985726E 
X( 6)= 0.75270749E 
X( 7)= 0.77532603E 
X( 8)= 0.68637722E 
X( 9)= 0,86208143E 

OLDF 0.5880E-02 

OLDF 0.5097E-02 

OLDF 0.4842E-02 

OLDF 0.4310E-02 

OLDF 0.4123E-02 

OLDF 0.3709E-02 

OLDF 0.3623E-02 

OLDF 0. 3590E-02 

OLDF = 0.3527E-02 

OLDF = 0.3213E-02 

OLDF = 0.3060E-02 

OLDF = 0.2971E-02 

OLDF = 0.2940E-02 

OLDF = 0.2932E-02 

OLDF = 0.2931E-02 


F= 0.29311E-02 


NO OF FUNCT EVALUATIONS= 


ooneonenen noe 


ooun ween 


Table 11 
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0.3244E-01 ITERATION 
0.3244E-01 ITERATION 
0.3230E-01 ITERATION 
0.3196E-01 ITERATION 
0.3077E-01 ITERATION 
0.3020E-01 ITERATION 
0.2964E-01 ITERATION 
0.2942E-01 ITERATION 
0.2914E-01 ITERATION 
0, 2865E-01 ITERATION 
0.2803E-01 ITERATION 
0.27525-01 ITERATION 


IER= 1 


X( 1)= 
X( 2)= 
X( 3)= 
X( 4)= 
X( 5)= 
x( 6)= 


0.41772590E 
0.57610147E 
0.62142190E 
0 .63898080E 
0.10983226E 
0.75217267E 
X( 7)= 0.77566455E 
X( 8)= 0.68576224E 
X( 9)= 0.86191942E 
0.2745E-01 
0.2745E-01 
0.2745E-01 
0.2745E-01 
0.2745E-01 
0.2745E-01 
0.2745E-01 
0.2745E-01 
0.2745E-01 
0.2745E-01 


IER= 0 


IER= 0 


X( 1)= 0.40242405E 
X( 2)= 0.59617415E 
X( 3)= 0.61030855E 


EVALUATIONS= 136 


254 


NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 
NO. 


25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 


NO OF ITERATIONS= 36 


00 
00 
00 


ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 


1)=-0.30741183E-02 
2)=-0.12525613E-02 
3)= 0.49062657E-02 
4)=-0.27420288E-02 
5)=-0.21828591E-01 
6)= 0.47436717E-02 
7)= 0.84268712E-02 
8) =-0 .63354241E-02 
9)= 0.17568368E-02 


CemBIauauns 


NO OF ITERATIONS= 10 


ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 
ITERATION 


1)= 0.23355838E-05 
2) =-0.63836675E-06 
3)= 0.41995328E-05 
4) =-0.48311127E-07 
5)= 0.11442379E-04 
6)= 0.16899898E-05 
7)= 0.43452516E-05 
8)= 0.31803929E-05 
9) =-0.64447522E-06 


COOITHBWN= 


NO OF ITERATIONS= 15 


00 
00 
00 


6.2-19 


Gl 
G 


G( 3)=-0.37734724E-04 


1)= 0.34703542E-04 
2)= 0.57860917E-04 


LPIIR 


IIR Programs 


Table 11 
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X( 4)= 0.66355933E 00 G( 4)= 0.35411865E-04 
X( 5)= 0.11052927E 01 G( 5)= 0.78650220E-04 
X( 6)= 0.77201111E 00 G( 6) =-0.12829921E-03 
X(_7)= 0.76772848E 00 G(_ 7)=-0.15171362E-03 
X( 8)= 0.71009994E 00 G( 8)=-0.34973891E-04 
X( 9)= 0.87403825E 01 G( 9)= 0.19682339E-05 


SYNTHESIS OF DIGITAL FILTER WITH SPEC. MAGNITUDE AND/OR GROUP 
THE ERROR CRITERION USED IS MINIMUM 0 FOR THE MAGNITUDE AND 
MINIMUM 4 FOR THE GROUP DELAY 
F= 0.29311E-02 IER= 0 NO OF ITERATIONS= 61 
NO OF FUNCT EVALUATIONS= 254 
COMPUTED ARG. VECTOR AND GRADIENT 
X( 1)= 0,40242405E 00 G( 1)= 0.34703542E-04 
X( 2)= 0.59617415E 00 G( 2)= 0.57860917E-04 
X( 3)= 0.61030855E 00 G( 3)=-0.37734724E-04 
X( 4)= 0.66355933E 00 G( 4)= 0.35411865E-04 
X( 5)= 0.11052927E 01 G( 5)= 0.78650220E-04 
X( 6)= 0.77201111E 00 G( 6)=-0.12829921E-03 
X(_ 7)= 0.76772848E 00 G( 7)=-0.15171362E-03 
X( 8)= 0.71009994E 00 G( 8)=-0.34973891E-04 
X( 9)= 0.87403825E 01 G{ 9)= 0.19682339E-05 
Z PLANE ZEROS 
ANGLE/ 2PI*FS RADIUS 
0.40242405E 00 0.16773622E 01 
0.61030855E 00 0.15070242E 01 
0.89470732E 00 0.12953181E 01 
0.76772848E 00 0.14082525E 01 
Z PLANE POLES 
ANGLE/2PI+*FS RADIUS 
0.40242405E 00 0.59617415E 00 
0.61030855E 00 0.66355933E 00 
0.89470732E 00 0.77201111E 00 
0.76772848E 00 0.71009994E 00 
CONST= 0.47031828E-01 
NUMERATOR COEFFICIENTS 
AO Al A2 
0.10000000E 01 -0.10123400E 01 0.28135440E 
0.10000000E 01 0.10237209E 01 0.22711221E 
0.10000000E 01 0.24501904E 01 0.16778491E 
0.10000000E 01 0.20993461E 01 0.19831751E 
DENOMINATOR COEFFICIENTS 
BO Bl B2 
0.10000000E 01 -0.35980954E 00 0.35542362E 
0.10000000E 01 0.45075555E 00 0.44031099E 
0.10000000E 01 0.14603163E 01 0.59600115E 
0.10000000E 01 0.10585783E 01 0.50424192E 


6.2-20 


Chapter 6 


DELAY 


01 
01 
01 
01 


Section 6.2 


FREQUENCY RESPONSE 


FREQUENCY 


0. 


0.2000E- 
0.4000E-' 
0.6000E- 
0.8000E-' 


0.1000E 
0.1200E 
0.1400E 
0.1600E 
0.1800E 
0.2000E 
0.2200E 
0.2400E 
0.2600E 
0.2800E 
0.3000E 
0.3200E 
0.3400E 
0.3600E 
0.3800E 
0.4000E 
0.4200E 
0.4400E 
0.4600E 
0.4800E 
0.5000E 
0.5200E 
0.5400E 
0.5600E 
0.5800E 
0.6000E 
0.6200E 
0.6400E 
0.6600E 
0.6800E 
0.7000E 
0.7200E 
0.7400E 
0. 7600E 
0.7800E 
0.8000E 
0.8200E 
0.8400E 
0.8600E 
0.8800E 
0.9000E 
0.9200E 
0.9400E 
0.9600E 
0.9800E 
0.1000E 


01 
01 
01 
01 


01 


MAGNITUDE 


0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 


0.10000E 01 
0.10000E 01 


0,10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 
0.10000E 01 


Table 11 
(Continued) 


Loss IN DB 


-0.12943E-06 
-0.12943E-06 
-0.12943E-06 
0.12943E-06 
-0.12943E-06 
0.12943E-06 
-0.12943E-06 
Oo. 
oO. 
0.12943E-06 
-0.12943E-06 
oO. 
O 


0.19414E-06 
0.19414E-06 
0. 

0.19414E-06 
0.12943E-06 
-0.12943E-06 
0.19414E-06 
0.12943E-06 
oO. 
0.12943E-06 
0.12943E-06 
0.12943E-06 
0,19414E-06 
0.19414E-06 
0. 38829E-06 
0.32357E-06 
0.19414E-06 
0.19414E-06 
0.32357E-06 
0.19414E-06 
0.12943E-06 
0.32357E-06 
0.19414E-06 
0.12943E-06 
0.12943E-06 
0.12943E-06 
0.19414E-06 
0.19414E-06 
0.12943E-06 
0.12943E-06 
0.12943E-06 
-0.12943E-06 
-0.12943E-06 
-0.51772E-06 
-0.38829E-06 
-0.64715E-06 
-0.38829E-06 
-0.51772E-06 


PHASE 


Oo. 

-0.15963E 00 
-0.32026E 00 
-0,.48288E 00 
-0.64857E 00 
-0.81845E 00 
-0.99375E 00 
-0.11758E 01 
-0.13661E 01 
-0.15664E 01 
0.13631E 01 
0.11370E 01 
0.89467E 00 
0.63358E 00 
0.35118E 00 
0.45080E-01 
-0.28666E 00 
-0.64506E 00 
-0.10298E 01 
-0.14389E 01 
0.12726E 01 
0.82590E 00 
0.36633E 00 
-0.10375E 00 
-0.58437E 00 
-0.10780E 01 
0.15525E 01 
0.10190E 01 
0.45890E 00 
-0.12938E 00 
-0.74340E 00 
-0.13773E 01 
0.11174E 01 
0.46125E 00 
-0.20509E 00 
-0.88765E 00 
0.15473E 01 
0.81139E 00 
0.47784E-01 
-0.73502E 00 
-0.15275E 01 
0.81401E 00 
-0.21088E-02 
-0.84736E 00 
0.14170E 01 
0.52951E 00 
-0.32665E 00 
-0.11181E 01 
0.13029E 01 
0.63709E 00 
0.19966E-07 


GROUP DE! 


0.25380E 
0. 25459E 
0.25696E 
0.26098E 
0.26673E 
0.27434E 
0.28400E 
0.29592E 
0.31036E 
0.32764E 
0.34810E 
0.37209E 
0 .39993E 
0.43182E 
0.46772E 
0.50716E 
0.54908E 
0.59166E 
0 .63246E 
0.66885E 
0 .69887E 
0.72209E 
0.74012E 
0.75620E 
0.77434E 
0.79817E 
0.82988E 
0.86945E 
0.91398E 
0.95794E 
0.99489E 
0.10209E 
0.10374E 
0.10513E 
0.10714E 
0.11035E 
0.11473E 
0.11948E 
0.12334E 
0.12555E 
0.12664E 
0.12827E 
0.13190E 
0.13728E 
0.14138E 
0.13991E 
0.13167E 
0.12012E 
0.10971E 
0.10293E 
0.10063E 


LAY 


o1 
01 
01 
o1 
01 
01 


02 


COEFFICIENTS OF DIGITAL FILTER WITH SPEC. AMPLITUDE AND/OR GROUP DELAY 


N= 4 


0.4703183E-01 4 

0.1000000E 01-0.1012340E 
0.1000000E 
0.1000000E 01 0.2450190E 
0.1000000E 01 0.2099346E 


01 0.1023721E 


01 0,2813544E 01-0.3598095E 00 0.3554236E 
01 0.2271122E 01 0.4507555E 00 0.4403110E 
01 0.1677849E 01 0.1460316E 01 0.5960012E 
01 0.1983175E 01 0.1058578E 01 0.5042419E 


6.2-21 


LPR 


TIR Programs Chapter 6 


Table 12 


32ecc000044++005 
SCAUWOSS000000 


anne 


FUNCTION: FS 
FUNCTION FOR SPECIFYING THE REQUIRED MAGNITUDE 


eanaaa 


FUNCTION FS(FI) 
COMMON /CM40/ FIK(10), NPK(10), NK 
COMMON /UNIT/ IND, INP, IOUTD, IOUTP, PI, SPM 


IF (FI.LT.PIK(K1) .OR. FI.GE.FIK(K)) GO TO 60 


GO TO (10, 20, 30, 40, 50), K1 
10 FS = 1.0 
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Table 13 
(Continued) 


FUNCTION: DGS 
FUNCTION FOR SPECIFYING THE REQUIRED GROUP DELAY 


10 
20 
30 
40 


50 
60 


FUNCTION DGS(FI) 
COMMON /CM40/ FIK(10), NPK(10), NK 


COMMON /UNIT/ IND, INP, IOUTD, IOUTP, PI, SPM 


DO 60 K=2,NK 
Ki =K-1 


IF (FI.LT.FIK(K1) .OR. FI.GE.FIK(K)) GO TO 60 


GO TO (10, 20, 30, 40, 50), K1 


DGS = 0.0 
CONTINUE 
RETURN 
END 


Table 14 


KO = 0.18284121E-01 


TO = 0.35229725E 01 


F= 0.34480E-02 IER= 0 NO OF ITERATIONS= 0 


NO OF FUNCT EVALUATIONS= 2 


INITIAL ARG. VECTOR AND GRADIENT 


X( 1)= 0,42000000E 00 
X( 2)= 0.63200000E 00 
X( 3)= 0.85100000E 00 
0.23800000E 00 
0.50700000E 00 
0.10100000E 00 
0.61900000E 00 
0.27400000E 00 
0.62900000E 00 
0.45800000E 00 
0.73200000E 00 
0.18284121E-01 
0.35229725E 01 


OLDF = 0.3448E-02 ITERATION 
OLDF 0.2780E-02 ITERATION 
OLDF 0.2675E-02 ITERATION 
OLDF 0.2158E-02 ITERATION 
OLDF 0.1901E-02 ITERATION 
OLDF 0.1798E-02 ITERATION 
OLDF 0.1665E-02 ITERATION 
OLDF = 0,1493E-02 ITERATION 


6.2-23 


1)= 0.21118077E-02 
2)= 0.28182383E-02 
3)= 0.63655715E-03 
4) =-0.73575538E-02 
5)= 0.39115127E-02 
6)= 0.20516445E-01 
7) =-0.42940497E-02 
8)= 0.17985253E-01 
0.18634771E-01 
0.13497053E 00 


G(11)= 0,83689370E-01 


G(12 


0.18122631E-06 


G(13)= 0.84692147E-08 


NO. 
No. 
NO. 
NO. 
NO. 
NO. 
NO. 
No. 


OIA RUN 


LPUR 


IIR Programs 


NO. 51 
NO. 52 


NO OF ITERATIONS= 52 


Table 14 
(Continued) 

OLDF = 0.1283E-02 ITERATION 
OLDF = 0.1191E-02 ITERATION 
OLDF = 0.1023E-02 ITERATION 
OLDF = 0.7016E-03 ITERATION 
OLDF = 0.6314E-03 ITERATION 
OLDF = 0.5193E-03 ITERATION 
OLDF = 0.4512E-03 ITERATION 
OLDF = 0.4389E-03 ITERATION 
OLDF = 0.4170E-03 ITERATION 
OLDF = 0.4020E-03 ITERATION 
OLDF = 0.3969E-03 ITERATION 
OLDF = 0.3826E-03 ITERATION 
OLDF = 0.3754E-03 ITERATION 
OLDF = 0.3713E-03 ITERATION 
OLDF = 0,3663E-03 ITERATION 
OLDF = 0.3616E-03 ITERATION 
OLDF = 0,3543E-03 ITERATION 
OLDF = 0.3468E-03 ITERATION 
OLDF = 0.3433E-03 ITERATION 
OLDF = 0.3215E-03 ITERATION 
OLDF = 0,3211E-03 ITERATION 
OLDF = 0,3184E-03 ITERATION 
OLDF = 0.3156E-03 ITERATION 
OLDF = 0.3127E-03 ITERATION 
OLDF = 0.3087E-03 ITERATION 
OLDF = 0.3052E-03 ITERATION 
OLDF = 0.3019E-03 ITERATION 
OLDF = 0.2990E-03 ITERATION 
OLDF = 0.2911E-03 ITERATION 
OLDF = 0.2890E-03 ITERATION 
OLDF = 0.2853E-03 ITERATION 
OLDF = 0.2834E-03 ITERATION 
OLDF = 0.2831E-03 ITERATION 
OLDF = 0.2823E-03 ITERATION 
OLDF = 0,2815E-03 ITERATION 
OLDF = 0.2799E-03 ITERATION 
OLDF = 0.2792E-03 ITERATION 
OLDF = 0.2784E-03 ITERATION 
OLDF = 0.2777E-03 ITERATION 
OLDF = 0.2771E-03 ITERATION 
OLDF = 0.2761E-03 ITERATION 
OLDF = 0.2753E-03 ITERATION 
OLDF = 0.2750E-03 ITERATION 
OLDF = 0.2746E-03 ITERATION 
F= 0.27332E-03 IER= 1 
NO OF FUNCT EVALUATIONS= 191 

X( 1)= 0.24982625E 00 

X( 2)= 0.62820711E 00 

X( 3)= 0,.84752128E 00 

X( 4)= 0.15254241E 00 

%( 5)= 0,.29627715E 00 

X( 6)= 0.10178863E 00 

X(_ 7)= 0.54562625E 00 

X( 8)= 0.31160252E 00 

X( 9)= 0.56832202E 00 

X(10)= 0.50460494E 00 

X(11)= 0.64320938E 00 

X(12)= 0.29779218E-02 

X%(13)= 0.30811412E 01 


G( 1)= 0.34937362E-02 
G( 2)=-0.13012964E-02 
G( 3)=-0.31967661E-03 
G( 4) =-0.89132080E-03 
G( 5)= 0.57309923E-02 
G( 6)=-0.81774487E-04 
G( 7)=-0.49900725E-03 
G( 8)= 0.13535585E-02 
G( 9)=-0,65854154E-03 
G(10)= 0.21895326E-02 
G(11)=-0.33977294E-03 
-0.20130444E 00 
G(13)= 0.11298486E-03 


Chapter 6 


SYNTHESIS OF DIGITAL FILTER WITH SPEC. MAGNITUDE AND/OR GROUP DELAY 


THE ERROR CRITERION USED IS MINIMUM 2 FOR THE MAGNITUDE AND 


F= 0.27332E-03 IER= 1 


NO OF FUNCT EVALUATIONS= 191 


MINIMUM 2 


FOR THE GROUP DELAY 


NO OF ITERATIONS= 52 


6,2-24 


Section 6.2 


Table 14 
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COMPUTED ARG. VECTOR AND GRADIENT 


0.24982625E 00 
0.62820711E 00 
0.84752128E 00 
0.15254241E 00 
0.29627715E 00 
0.10178863E 00 
0.54562625E 00 
0.31160252E 00 
0.56832202E 00 


= 0.50460494E 00 


ANGLE/ 2PI*FS 


oO. 
0 


ANGLE/ 2PI+*FS 


0.10178863E 00 
0.31160252E 00 
0.50460494E 00 


CONST= 0.29779218E-02 


AO 


0.10000000E 01 
0.10000000E 01 
0.10000000E 01 
0.10000000E 01 
0.10000000E 01 


0.64320938E 00 


= 0.34937362E-02 
0 .13012964E-02 
0.31967661E-03 
G( 4)=-0.89132080E-03 
G( 5)= 0.57309923E-02 
G( 6)=-0.81774487E-04 
G( 7)=-0.49900725E-03 
0.13535585E-02 
0.65854154E-03 
G(10)= 0.21895326E-02 
G(11)=-0.33977294E-03 


0.29779218E-02 
0.30811412E 01 


0.62820711E 00 
0.84752128E 00 
0.15254241E 00 
0.15254241E 00 


Z PLANE ZEROS 
RADIUS 


0 .24982625E 
0.40027819E 
0.10000000E 
0.10000000E 
0.29627715E 
0.33752181E 


2 PLANE POLES 
RADIUS 
0 .54562625E 


0.56832202E 
0 .64320938E 


NUMERATOR COEFFICIENTS 


Al 


-0.42526081E 01 
0.78394464E 00 
0.17748885E 01 
-0.52580426E 00 
-0.59900133E 01 


DENOMINATOR COEFFICIENTS 


BO 


0.10000000E 01 
0.10000000E 01 
0.10000000E 01 
0.10000000E 01 


BI 


-0.10359316E 01 

-0.63414777E 00 
0.18609760E-01 
0. 


00 
00 
00 


0.20130444E 00 
0.11298486E-03 


A2 


0.10000000E 01 
0.10000000E 01 
0.10000000E 01 
0.87780149E-01 
0.11392097E 02 


B2 


0.29770800E 00 
0.32298992E 00 
0.41371830E 00 
0. 


LPIIR 


0.10000000E 01 0. 0. 

FREQUENCY RESPONSE 

FREQUENCY MAGNITUDE LOSS IN DB PHASE GROUP DELAY 
oO. 0.98200E 00 0.15780E 00 oO. 0.60749E 01 
0.2000E-01 0.98309E 00 0.14814E 00 -0.38178E 00 0.60788E 01 
0.4000E-01 0.98617E 00 0.12095E 00 -0.76402E 00 0.60889E 01 
0.6000E-01 0.99071E 00 0.81041E-01 -0.11470E 01 0.61007E 01 
0.8000E-01 0.99600E 00 0.34840E-01 -0.15306E 01 0.61087E 01 
0.1000E 00 0.10013E 01 -0.11414E-01 0.12272E 01 0.61085E 01 
0.1200E 00 0.10061E 01 -0.53237E-01 0.84362E 00 0.60983E 01 


6.2-25 


TIR Programs 


0.1400E 
0.1600E 
0,1800E 
0.2000E 
0.2200E 
0.2400E 
0. 2600E 
0.2800E 
0.3000E 
0.3200E 
0.3400E 
0.3600E 
0.3800E 
0.4000E 
0.4200E 
0.4400E 
0.4600E 
0.4800E 
0.5000E 
0.5200E 
0.5400E 
0.5600E 
0.5800E 
0.6000E 
0.6200E 
0.6400E 
0.6600E 
0.6800E 
0. 7000E 
0.7200E 
0.7400E 
0.7600E 
0.7800E 
0.8000E 
0.8200E 
0.8400E 
0.8600E 
0.8800E 
0.9000E 
0.9200E 
0.9400E 
0.9600E 
0.9800E 
0.1000E 


01 


0.10102E 01 
0.10136E 01 
0.10160E 01 
0.10175E 01 
0.10171E 01 
0.10139E 01 
0.10059E 01 
0.99148E 00 
0.96885E 00 
0.93692E 00 
0.89543E 00 
0.84490E 00 
0.78632E 00 
0.72079E 00 
0.64928E 00 
0.57264E 00 
0.49196E 00 
0,40905E 00 
0.32679E 00 
0,24884E 00 
0.17886E 00 
0.11943E 00 
0.71615E-01 
0.35037E-01 
0,84207E-02 
0 .98863E-02 
0.21544E-01 
0.28034E-01 
0.30599E-01 
0.30248E-01 
0.27784E-01 
0.23845E-01 
0.18939E-01 
0.13470E-01 
0.77640E-02 
0.20841E-02 
0,33559E-02 
0 .83817E-02 
0.12852E-01 
0.16655E-01 
0.19701E-01 
0.21922E-01 
0.23274E-01 
0.23727E-01 


Table 14 
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-0.88524E-01 
-0.11694E 00 
-0.13830E 00 
-0.15047E 00 
-0.14766E 00 
-0.11948E 00 
-0.51280E-01 
0.74290E-01 
0.27488E 00 
0.56594E 00 
0.95935E 00 
0.14639E 01 
0.20880E 01 
0.28438E 01 
0.37513E 01 
0.48423E 01 
0.61614E 01 
0.77644E 01 
0.97147E 01 
0.12081E 02 
0.14950E 02 
0.18458E 02 
0.22900E 02 
0.29109E 02 
0.41493E 02 
0.40099E 02 
0,33334E 02 
0.31046E 02 
0.30286E 02 
0.30386E 02 
0.31124E 02 
0.32452E 02 
0.34453E 02 
0.37413E 02 
0.42198E 02 
0.53622E 02 
0.49484E 02 
0.41533E 02 
0.37820E 02 
0.35569E 02 
0.34110E 02 
0.33182E 02 
0.32663E 02 
0.32495E 02 


0.46099E 00 
0.79619E-01 
-0.30054E 00 
-0.67991E 00 
-0.10592E 01 
-0.14391E 01 
0.13214E 01 
0.93892E 00 
0.55552E 00 
0.17188E 00 
-0.21119E 00 
-0.59313E 00 
-0.97394E 00 
-0.13542E 01 
0.14066E 01 
0.10244E 01 
0.64057E 00 
0.25639E 00 
-0.12523E 00 
-0.49999E 00 
-0.86327E 00 
-0.12113E 01 
-0.15419E 01 
0.12871E 01 
0.99160E 00 
0.71175E 00 
0,.44571E 00 
0.19166E 00 
-0.52120E-01 
-0.28713E 00 
-0.51469E 00 
-0.73591E 00 
-0.95174E 00 
-0.11630E 01 
-0.13704E 01 
0.15671E 01 
0.13658E 01 
0.11667E 01 
0.96953E 00 
0.77388E 00 
0.57941E 00 
0.38580E 00 
0.19276E 00 
0.60857E-08 


0.60802E 
0.60594E 
0,60425E 
0.60351E 
0.60397E 
0.60553E 
0.60765E 
0.60959E 
0.61062E 
0.61032E 
0.60886E 
0 .60690E 
0.60544E 
0.60536E 
0.60698E 
0.60967E 
0.61169E 
0.61040E 
0.60316E 
0.58849E 
0.56684E 
0.54035E 
0.51179E 
0 .48360E 
0.45738E 
0.43391E 
0.41340E 
0.39574E 
0,.38064E 
0.36778E 
0.35685E 
0.34756E 
0.33967E 
0.33297E 
0.32730E 
0.32252E 
0.31852E 
0.31520E 
0.31250E 
0.31037E 
0.30874E 
0.30761E 
0.30693E 
0.30671E 
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01 
01 
01 
01 
01 
01 


COEFFICIENTS OF DIGITAL FILTER WITH SPEC. AMPLITUDE AND/OR GROUP DELAY 


N= 5 


0 .2977922E-02 5} 
0.1000000E 
0.1000000E 
0.1000000E 
0.1000000E 
0.1000000E 


01-0. 4252608E 
01 0.7839446E 
01 0.1774889E 
01-0.5258043E 
01-0.5990013E 


01 
00 
01 
00 
01 


0.1000000E 01-0.1035932E 01 0.2977080E 00 
0.1000000E 01-0.6341478E 00 0.3229899E 00 
0.1000000E 01 0.1860976E-01 he 4137183E 00 


0.8778015E-01 0 
0.1139210E 02 0. 


6.2-26 


o 


GSNOdSIU AONANOSUA BHL YOA LIWIT AONENOSYA BAMOT = 14 
ANI (6666‘GNI) avau 
SONZOUTANOD ON 4I SHIOKD IVLOL 40 USEWAN = ANI 
g (taI* L=IE*(1T)OT) (6666*aNI) avay 
= AVIdd dNO¥D SHL YOd NOILVWIXOWddY 4O SHOIGNI 3AISSD9NS = (II)OI 
(4aI* L=II* (TI) dT) (6666"GNT) avau 
SQNLINOVW SHL YOd NOILVWIXOWddY 40 SHOIGNI SAISSEDONS = (II) dr 
WdI (6666°0NI) avau 
NOILVWIXOWddY dO SZOIGNI S3AISSEDONS 40 ON = aI 
QIN’ b=I*(1)%Ta) (8666*ONT) avau 
‘IWAUSENI "XO¥ddV HL I HL dO LNIOd ONILYVLS = (I)¥IA 
b+ ON = ON 
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An Optimization Program for the 
Design of Digital Filter Transfer Functions 


M. T. Dolanand J. F. Kaiser 


Digital Systems Research Dept. 
Bell Laboratories 
Murray Hill, NJ. 07974 


1. Purpose 

Given the cascade realization of a digital filter transfer function, this program varies the coefficents 
until the performance meets arbitrary frequency-domain specifications on the magnitude. The response 
is calculated as insertion loss in dB. 
2. Method 


The method solves the design problem by working directly with the coefficients of the transfer func- 
tion 
" ayj2 7? +a2271 +1 


H(z! ;@) = a (1) 
> 2 HH 03;27? + ag27! +1 
where @ = [ap, a1, 071,031, 04), -. . ,@4,]', 27! = e~7 and Tis the sampling period. Note that N=4n 


is the total number of coefficients in n second-order sections. For a given sampling rate, the system is 
completely defined if mand @ are known. This initial design is usually obtained by standard approxima- 
tion techniques [1]. 

Let L(w;a) be a function of the filter on which insertion loss specifications are imposed and 
(@), h(w) be two given real-valued functions of w defined, respectively, on ©, and 2), two not- 
necessarily-disjoint intervals on the frequency axis. Then, all the common filter or equalizer 
specifications can be expressed by requiring the following inequalities to be satisfied: 


Sfilw;a) = L(w;a) — i (w) 20, wo 9, (2) 


S(wxa) = b(w) — L(w;a)>0, wo, 
A vector « of a given dimension which satisfies the inequalities belongs to the specification set S, 
S = {a| f,(o;a) 20, CO); fylw;a) 20, wo 0} (3) 

A stable digital filter for which aCS will be called acceprable, the philosophy being that a solution (not 
necessarily a global optimum) satisfies the specifications. There are no constraints on stability. Since 
we are dealing with insertion loss only, if a final design is unstable, it is made stable by inversion of the 
poles which lie inside the unit circle in the z~' plane. 

The specification set S is defined in (3) through an infinite number of constraints. Because of the 
discrete nature of the computation, the user must select a finite number of discrete frequencies w, in 
Q, and 0. The program works with the discretized specification set 


Sy = (alfloyse) = L(oysa) — hw) 20, «CO, k=1,2,....m5 (4) 


Sosa) = lw) — L(wy3e) 20, oC 22, k=m)41,....m)} 


Figure 1 is an example of a lowpass filter H(z~' ;) with frequency response L(w,;a). The filled 
circles mark the selected frequencies @,. The vector a belongs to the discretized specification set Sy of 
(4) which in this case is a subset of S since the specifications are not violated between the selected fre- 
quencies. Note that S, is, of course, not necessarily a subset of S because there may exist a C Sy and 
w © 2; Q) which do not satisfy the original specifications (2). This makes the selection of the 
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ooo — ese E(u) 


L(W_; @) 


INSERTION LOSS IN dB 


Fy Fo Fs 
FREQUENCY IN HZ 


Fig. 1 Lowpass filter response meeting discretized specifications 
© — selected frequencies a, 


04: a, 0 < oy <A. k= 12,.0my and Ry < ay <A, k= myth... 
0; oy, 0S ay <A k= mF. 


frequencies w, somewhat of an art because one would like to keep their number, m, as low as possible 
(in order to economize computation) but, at the same time, consider enough constraints to have a rea- 
sonable assurance that the solution a’ of an optimization problem based on Sq will also belong to S. 


The optimality criterion adopted is of the following min-max character: If a filter of a given order is 
acceptable, then maximize the minimum amount by which it exceeds the specifications; if it is not 
acceptable, then minimize the maximum amount by which it fails. 


The problem is expressed mathematically by making use of an additional variable ay, (excursion 
from specifications) and introducing non-negative weights wy, and w« multiplying a@y,; in each con- 
straint. The problem becomes: 
minimize 

N+ 
subject to 


Cx (@)= mays, + A (Oxia) 20, kK=1,2,....m (5) 


Cy (@= wyyeays, + flops) 20, k=m, +1, +2,....m 


The optimization is’ performed in the space of the augmented vector @ = [alayy;]'. Clearly, if ans, 
the final value of ay), is nonpositive, then the filter meets the discretized specifications. If ays; > 0, 
then the final filter is not acceptable and Ona represents the minimum of the maximum amount by 
which the constraints of S, in (4) cannot be satisfied. Similar formulations have been used in approxi- 
mation methods [2], in the parameter optimization of networks in the time [3] or frequency domain 
[4,5,6], and in the design of antennas [7]. 


The values of the input weights may be adjusted by the user so that certain regions of 2, or 22 
require greater attention than others. 


The solution of the nonlinear program of (5) by a sequence of unconstrained minimizations is 
accomplished through the use of an auxiliary or "penalty" function A(&;r,), where r, is a positive 
parameter. The auxiliary function A (&;r,) consists of the objective function plus a penalty term which 
is a monotonic function of the constraints multiplied by r, and so formulated that it reduces the value 
of A(&;r,) when & belongs to S, and/or “penalizes” the minimization of A(@;r,) when @ is on the 
boundary or the exterior of the specification set Sy. A(&;r,) is minimized sequentially over all 
& C RNt! for a sequence of r,, v = 1,2,..., giving minima & (r,). If A(&;r,) and the sequence <r,> 
are properly constructed, then the sequence <a (r,)> converges to the solution & of the original 
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nonlinear program [8]. In all cases, as the auxiliary function is minimized for a sequence of values r,, 
the penalty term tends to zero so that the successive minima of the auxiliary function converge to the 
minimum of the objective function. 


Two auxiliary functions used in the program are the following: 


bel m 1 
A\(@rJ= +r, +r, ——— 6) 
ARR i aalay PE : 
Axl@sr)= ayer —r, S In(C,(@)) —r, F In(Cy(A)) ) 
kel 


k=my+l 


When either of these functions is minimized sequentially, for a monotonically decreasing sequence of 
positive r, (which tend to 0), then the sequence of the successive global minima &'(r,) converges to 
the solution of (5). A detailed treatment of the properties of these techniques is given in chapter 3 of 
reference [8]. 


Functions (6) and (7) are often called "interior" because they have the property that, if the initial 
value of & belongs to S,, then all the subsequently generated solutions @"(r,) are in Sy as well. Both 
(6) and (7) approach infinity as any constraint approaches zero; therefore, any minimization procedure 
will tend to avoid the boundary of the constraint set. In interior methods, each time r, is reduced, the 
weighting of the penalty term is decreased while the weighting of the objective function is increased, As 
for the initial value of & belonging to S,, one can always find such an initial point by taking the initial 
value of ay,; large enough. When an interior penalty function is selected, the program automatically 
determines this initial value for the user. 


Auxiliary functions which can work with points outside of S, are called "exterior". The program 
incorporates one such function as an option: 


my - m a 
As@r,) = any tr, DICY@P +r, Y (Cy (@P (8) 
k=l kommt 
where 
€,,(@=0 if C\,(@) >0 


= Cy (@ if Cy, (@ <0 


and similarly for Cy, (@). This function is minimized sequentially for a monotonically increasing 
sequence of positive r, (which tend to co) and has analogous convergence properties with those of (6) 
or (7), See [9] or Chapter 4 of [8]. In exterior methods, the penalty term prevents the points from 
straying too far from the feasible region. Only the constraints (5) which are violated enter the compu- 
tation at any time. It is especially true in exterior methods that the sign of ay; is not significant 
before convergence. Convergence implies that subsequent values of r, will reduce ay4,; by amounts 
too small to justify the expenditure. In a wide range of problems, four values of r,, i.e, four major 
iterations have been sufficient. Typically, in exterior methods, the initial r, is 1 and is multiplied by 10 
in each succeeding major iteration. In interior methods, the initial r, is usually less than 1 and is 
divided by 10 in succeeding major iterations. 


The test program of the Appendix provides an option for automatic selection of many of the optimi- 
zation parameters for both types of auxiliary functions. 


The unconstrained minimizations of the above auxiliary functions begin with an initial point & and 
generate a sequence of points <@ >, such that 


A(Gj41317,) < A(&% 5r,) (9) 
by taking a step , along a direction vector d, C R**!. Thus, 
aan = &, + od, (10) 


A class of unconstrained minimization methods, known as quasi-Newton methods, compute the direc- 
tion vectors as 
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d= — 8; qa) 


where g, = g(@;) is the gradient vector of A(&:r,) with respect to & and Q, is a positive-definite 
(N+1)x(N+1) matrix which is updated at each iteration. Broyden [10] suggested the following general 
updating expressions 


Oi41 = Q, — Qyyivi + Biai (12) 

where 
Yi = Bir — & (13) 
B, = 41 — & (14) 


and the vectors p, and q; are arbitrary except for the normalizing condition 
ply = aiy, = 1 (15) 
The specialization of (12) included in the program is the well-known method of Davidon-Fletcher- 
Powell [11]. 
p= (y/Qi7i)'Oiv, (16a) 
a= (Biy)'B; (16b) 

The length of the step o, is determined at each iteration by minimizing A (@;r,) along d, by means 
of a quadratic approximation of the function along d,. 

Finally, there is a choice of algorithms for "stop" criteria. Note that convergence to a negative ay 4) 
indicates that the frequency response satisfies the specifications at the frequencies chosen by the user. 
Users should check the resulting transfer function by generating a frequency response using the subrou- 
tine CASC of the Appendix. Comments in the subroutine include notes for its use outside the pack- 
age. If specifications are violated between the frequencies selected, additional frequencies should be 
included. The optimization is greatly facilitated by a good initial design and a judicious choice of fre- 
quencies at which the specifications must be met. 


3. Program Description 


3.1 Usage 


The package consists of a test program and nine subroutines - ZR, FLPWL, STEP, QUAD, FUNC, 
FG, CASC, RINV, FINISH. The test program and the subroutines are in the Appendix. 


The test program reads in the data required to describe the digital filter transfer function and the 
frequency-domain specifications calculated as insertion loss in dB. Various optimization parameters 
must also be read in. The coefficients are varied by the appropriate subroutines until the "stop" cri- 
terion is satisfied. 


For the sake of portability, all data is read in as formatted input. In some situations such as in the 
case of linear frequencies or analytic specifications, users may want to modify the test program to gen- 
erate such data or read it from files. 


ZR calculates the initial ay,, (ALPHA) and sets the initial value r, (R) for the chosen penalty 
function (6), (7), or (8). Users have the option to set the initial r,. 


FLPWL computes the direction vector (11) for each iteration. 

STEP sets the initial value of o, of (10). 

QUAD _ performs on the function to be minimized quadratic interpolations for successive minima. 
FUNC _ evaluates the penalty function. 

FG evaluates the penalty function and its gradient. 


CASC calculates the frequency response and its gradient. The response is calculated as insertion loss 
in dB. 


RINV checks that the modified transfer function printed after each major iteration is stable. Since 
the coefficients are in the z~' plane, poles are inverted if necessary so that they lie outside the 
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unit circle. 


FINISH checks whether or not the stop criterion has been met and takes the appropriate action. 
3.2 Description of Required Data 


The notation below is not quite consistent with that in the earlier general discussion; it is instead 
consistent with the actual code and printout. 


NORD 


XK 


NC 


NL 


NG 


NF 


FREQ 


NI 


SPECI 


THI 


N2 


(ORDER) The order of the filter must be an even number, NORD< 20 (NORD=2n where 
nis the number of second-order sections). For odd order filters, use the next higher even 
order, set appropriate coefficients to zero and request that they remain constant. For exam- 
ple, if the numerator and denominator are both to be seventh order, set 42, and B2, equal 
to zero in the array of coefficients described below. 

(SAMPLING TIME IN SECONDS) T = 1/sampling-frequency. 


(GAIN FACTOR) On input, XK contains the gain factor associated with the initial design. 
On output, it is the gain factor associated with the final design. 
(ARRAY of COEFFICIENTS) On input, X contains the coefficients of the transfer function 
of the initial design. For example, let 
1 A227+A1,27'+1 
H(z"! :x) = gx] ————_—_ 

(1) 8x T Bo BL 


+ «el 
The system expects the number of coefficients to be twice the order of the filter and in the 
following sequence: 


x = [A2),A1,,B2),B1,,A 23,4 17,B29,B lqy-.0,A 2A 1,,B2_,.B1 p]! 
On output, X contains the coefficients of the optimized transfer function. 
(NUMBER OF COEFFICIENTS TO REMAIN CONSTANT) Any of the 4n coefficients may 
be held fixed during the optimization. NC = total count of those coefficients that must not 
change. 
(ARRAY OF INDICES OF FIXED COEFFICIENTS) NL contains the indices of coefficients 
to be held fixed. In the coefficient vector, x, index 1 refers to 42), 2 refers to 41), etc. 
(GAIN OPTION) If NG = 1, the optimizer changes the initial gain factor in addition to the 
coefficients free to change. If NG = 0, the gain remains unchanged. In most cases, it is 
advisable that the gain factor be free to vary. 
(NUMBER OF FREQUENCIES FOR OPTIMIZATION) NF = count of the frequencies 
available to the optimizer - limit is 42. 
(ARRAY OF FREQUENCIES IN HZ) The goal of the optimizer is to satisfy the 
specifications at these selected frequencies. 
(INDEX FOR TOP RANGE (1 - N1) OF LOWER SPECIFICATIONS) If, for example, the 
lower specifications apply to the Ist through 10th frequencies, the user would input 10 for 
N1. The 1 at the beginning is fixed. This is not a serious restriction since frequencies do not 
have to be in any special order. The first NI can be chosen from anywhere in the range. Of 
course, the desired order must be set up in the frequency array. Note that the goal of the 
optimizer is to keep the loss above (greater than) the lower specifications at the given fre- 
quencies. 
(ARRAY OF LOWER SPECIFICATION DATA) Contains lower specifications calculated as 
loss in dB. 
(ARRAY OF WEIGHTS FOR LOWER SPECIFICATIONS) Contains non-negative weights 
associated with the lower specifications. 


(LOWER INDEX FOR RANGE (N2 - N3) OF UPPER SPECIFICATIONS) If, for example, 
the upper specifications apply at the 10th through 20th frequencies, the user inputs N2 equal 
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N3 


SPEC2 


TH2 


NGID 


NOUT 


NN 


VBND 


NPEN 


to 10. 


(UPPER INDEX FOR RANGE (N2 - N3) OF UPPER SPECIFICATIONS) When the upper 
specifications apply at the 10th through 20th frequencies, e.g., the user inputs N3 equal to 20. 
Note that the optimizer works to keep the loss below (less than) the upper specifications at 
the given frequencies. 


(ARRAY OF UPPER SPECIFICATION DATA) Contains the upper specification data calcu- 
lated as loss in dB. 


(ARRAY OF WEIGHTS FOR UPPER SPECIFICATIONS) Contains non-negative weights 
associated with the upper specifications. 


(OPTIMIZATION GUIDE OPTION) Set NGID=1 and no additional input is necessary. The 
remaining parameters will be set by the test program. Set NGID=0 to guide the optimiza- 
tion, i.e., to choose values for the remaining parameters. 


(OUTPUT OPTION) NOUT=0 for final results of major iterations, NOUT=1 for detailed 
output of minor iterations. Along with the initial coefficients and the R value, final results 
include the final coefficients for each major iteration, the gain factor, maximum excursion 
from specifications (ALPHA), penalty function value, modified coefficients (poles in 27! 
plane made to lie outside unit circle), corresponding modified gain factor, the gradient vector, 
the number of function evaluations, and the number of gradient evaluations. Detailed output 
includes, of course, the results described above and in addition, for each minor iteration, the 
coefficient vector, gain factor, maximum excursion from specifications (ALPHA), penalty 
function value, initial step, and the number of times the constraints were violated during qua- 
dratic fit. Note that the number of minor iterations corresponds to the number of gradient 
evaluations. On rare occasions, it may be of interest to follow the optimization, but the user 
is warned that NOUT=1 often produces a wallpaper effect. 


(INITIAL STEP OPTION - NN=1 FOR STEP BASED ON MAX. COEF. EXPECTED, 2 
FOR STEP BASED ON APPROX. FUNC. MIN.; 3 FOR OPTION | ONCE THEN DIVI- 
SION BY 2) For option | user is expected to provide an estimate of the maximum coefficient 
expected (VBND). 


srEP-mil 2, Wa | 


max. abs. component of direction vector 
For option 2 user is expected to provide an estimate of the function minimum (VBND). 


—2 x (func. — VBND) 
gradient transpose * direction vector 


STEP=min]| 2, 


Since option 3 uses option | once, user is expected to provide VBND. Subsequently, the 
current step will be divided by 2 for a new step. 


(PARAMETER FOR INITIAL STEP OPTION) For step options | or 3, VBND is the max- 
imum coefficient expected. If user inputs 0., default option sets VBND equal to 
.05 x (initial maximum absolute coefficient). For step option 2, VBND is the approximate 
function minimum. There is no default option. 


(PENALTY FUNCTION - NPEN=1 FOR RECIPROCAL INTERIOR, 2 FOR LOGA- 
RITHMIC INTERIOR; 3 FOR PARAMETRIC EXTERIOR) Penalty Function: 


P=atr, le(x)] 
where a = the maximum excursion from specifications and r, is the positive parameter of 
(6), (7), and (8) of the general discussion. 


Option | sets 
oer ae | 
ole) = > — + EY — 


kat Clk keN2 ©2k 
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Option 2 sets 
NI N3 
dle) = -1¥ inley) + Y Inlc,) 
k=l A=N2 
Option 3 sets 


M N3 
dle(x] = Fe, + Y ch 


k=l A=N2 


_ 0 ite, 0 
where ¢1,.= cy if oy, <0 


and similarly for ¢,. 


The constraint set c(x) is defined as follows 
CK =LG) +wya-h, 20 k= 1,2,3,...,N1 
6% = LUG) + wyath, 20  & =N2,N241,....N3 
where 
L(f,) is the filter loss in dB at the k'" frequency. 
wi, is the weight associated with the lower specification at the k'” frequency. 
a is the lower specification at the k'" frequency. 
Wr, is the weight associated with the upper specification at the k" frequency. 
ky is the upper specification at the &"" frequency. 
a is the maximum excursion from the specifications. 


KP (STOP CRITERION FOR MINOR ITERATIONS. KP=1 FOR STOP BASED ON GRA- 
DIENT CHANGES; 2 FOR STOP BASED ON FUNCTION CHANGES; 3 FOR OPTION 2 
SATISFIED A GIVEN NO. OF TIMES; 4 FOR STOP BASED ON COEFFICIENT 
CHANGES, 5 FOR STOP AFTER FIXED NO. OF ITERATIONS) Option 1 - stop when 
gradient transpose times gradient is less than some value given by user. Option 2 - stop 
when present function value minus previous function value is less than .0001 times present 
value. Option 3 - stop when option 2 is satisfied a number of times set by the user. Option 
4 - stop when maximum absolute coefficient minus previous maximum absolute coefficient 
is less than a given value set by the user. Option 5 - stop after a given number of iterations 
set by user. 


EPS (EPS - PARAMETER FOR MINOR STOP OPTION) This parameter is used in stop 
options | and 4. The default value for option 1 is gradient-transpose times gradient divided 
by 1.E+06. Default value for option 4 is .0005 times present maximum absolute coefficient. 
Input 0. for default. 


KTIME (PARAMETER FOR MINOR STOP OPTIONS) This parameter is used in stop options 3 
and 5. For option 3 the default number is 4. 


NFINR (STOP CRITERION FOR MAJOR ITERATIONS. NFINR=1 FOR STOP BASED ON 
ALPHA CHANGES OR SIZE OF CONSTRAINTS-SQUARED; 2 FOR STOP AFTER 
FIXED NO. OF R-VALUES) Option | - for interior reciprocal and logarithmic penalty func- 
tions - stop when present ALPHA value minus previous ALPHA value is less than a given 
percentage of the present value. User provides percentage. Option 1 - for parametric exte- 
rior penalty function - Program stops when sum of constraints-squared is less than a given 
value. User provides the value. Option 2 - may be chosen for any penalty function - User 
provides the number of major iterations desired. 
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PERR (PERCENTAGE) This parameter is used for stop option | with interior penalty functions. 


TAZ (SUM OF CONSTRAINTS-SQUARED) Parameter used only with stop option 1 with exte- 
rior penalty function. 
NR (NUMBER OF R-VALUES) User is expected to provide this number for stop option 2. 


INIR (R GUIDE OPTION - INPUT 0 FOR AN AUTOMATIC INITIAL R-VALUE AND 
CHANGE FACTOR, OTHERWISE INPUT 1) 
If the user inputs 0, a good starting r-value will be calculated based on the assumption that 
the two terms in the penalty function be of the same order of magnitude. Also the change 
factor is set to 10. 


RINI (INITIAL R-VALUE) Used only if the user set INIR=1. 
RCHNG (R CHANGE FACTOR) Used only if user set INIR=1. 


4. Test Problem 


Design a lowpass filter with cutoff frequency 4000 Hz for a sampling frequency of 32000 Hz. The 
following limits are imposed on the magnitude-frequency characteristic: 


LOWER SPECIFICATIONS 
In the passband, the insertion loss is required to be greater than 


sin(/8000) | ap 
7 f/8000 


In the stopband, the insertion loss is required to be greater than 


sin (7 f/8000) | a 


—0.1 + 20.xlogi9 


30. + 20.xlogio 7 //8000 


UPPER SPECIFICATIONS 


In the passband, the insertion loss is required to be less than 


2 
sin(zf/8000) 
+0.1 + 20 xl TROD dB 


For an initial design, the choice is a lowpass sixth-order elliptic filter with a minimum stopband loss 
of 30 dB and a ripple factor of 0.2 dB. 


The main program (Appendix) reads in the parameters described in Section 3.2 and for each major 
iteration prints, among other things, the transfer function, the gain factor, and the maximum excursion 
from the specifications, ALPHA. Convergence to a negative ALPHA means that the filter meets the 
specifications at the frequencies selected. 


Table 1 contains the input data and Table 2 the output. Figure 2 shows the frequency response for 


the 
800 
INITIAL 
ZS 600 RESPONSE 
=z 400 
i 
Wn 200 
Zio fo) 
onl 


-200 (aes 
“oO 2000 4000 6000 8000 10000 12000 14000 16000 


FREQUENCY IN HZ 
Fig. 2. Example - initial design 


initial design. Filled circles mark the discrete frequencies w, of (4). Note that the specifications are 
satisfied in the stopband but violated in the passband. Figure 3 is a blowup of the passband region of 
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INSERTION LOSS IN dB 


° ‘800 600 2400 3200 ‘4000 
FREQUENCY IN HZ 


Fig. 3. Blowup of passband - initial design 
the initial design showing that the specifications are violated by approximately 5 dB. 
Figure 4 is the optimized design. The stopband underwent little 


INSERTION 
Loss IN dB 


fp 
“Oo 2000 4000 6000 8000 10000 12000 14000 16000 
FREQUENCY IN HZ 
Fig. 4 Example - final design 


change during the optimization. Figure 5 is a blowup of the passband region of the optimized 


INSERTION LOSS IN dB 


FREQUENCY IN Hz 
Fig. 5 Blowup of passband - final design 


design where most of the change took place. The specifications are clearly satisfied. 
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5. 


val 
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Table 1 


6 0.31250000E-04 0.48525318E-01 

0.10000000E+01 -0.13200034E+01 0.95917120E+00 -0.13700062E+01 
0.10000000E+01 -0.11366976E+01 0.79029629E+00 -0.13095079E+01 
0.10000000E+01 0.30500371E+00 0.43064909F+00 -0.11934469E+01 


3 
1 SoD 
1 28 


0.10000000E-02 0.39979457E+03 0,69890112E+03 0.99680567E+03 
0.12930097E+04 0.15870320E+04 0.18784126E+04 0.21667174E+04 
0.24515404E+04 0.27325081E+04 0.29175082E+04 0.31005501E+04 
0.31913099E+04 0.44034865E+04 0.46480381E+04 0.50430803E+04 
0.54222495E+04 0.61329350E+04 0.67815157E+04 0.73711900E+04 
0.79061884E+04 0.88310266E+04 0.95931836E+04 0.10225487E+05 
0.10754695E+05 0.11201857E+05 0.12446131E+05 0.13191388E+05 
28 
-0,10000000E+00 -0.17149741E+00 -0.31933432E+00 -0,.54880904E+00 
-0 .86123592E+00 -0.12584475E+01 -0.17428471E+01 -0.23174821E+01 
-0.29861407E+01 -0.37534815E+01 -0.43226320E+01 -0.49401417E+01 
-0.52677316E+01 0.18688911E+02 0.16903418E+02 0.13416951E+02 
0.90909537E+01 -0.42527329E+01 -0.27946299E+03 -0.86185069E+01 
0.21700557E+00 0.30703544E+01 -0.56281188E+01 -0.27946299E+03 
-0.99938936E+01 -0.58035957E+01 -0.11648717E+02 -0.16014496E+02 
0.10000000E+01 0.10000000E+01 0.10000000E+01 0.10000000E+01 
0.10000000E+01 0.10000000E+01 0.10000000E+01 0,10000000E+01 
0.10000000E+01 0.10000000E+01 0.10000000E+01 0.10000000E+01 
0.10000000E+01 0.10000000E+01 0.10000000E+01 0.10000000E+01 
0.10000000E+01 0.10000000E+01 0.10000000E+01 0.10000000E+01 
0.10000000E+01 0.10000000E+01 0.10000000E+01 0.10000000E+01 
0.10000000E+01 0.10000000E+01 0.10000000E+01 0.10000000E+01 
113 
0.10000000E+00 0.28502590E-01 -0.11933433E+00 -0.34880904E+00 
~0.66123592E+00 -0.10584475E+01 -0.15428471E+01 -0.21174821E+01 
-0.27861407E+01 -0.35534815E+01 -0.41226320E+01 -0.47401417E+01 
~0.50677316E+01 
0.10000000E+01 0.10000000E+01 0.10000000E+01 0.10000000E+01 
0.10000000E+01 0.10000000E+01 0.10000000E+01 0.10000000E+01 
0.10000000E+01 0.10000000E+01 0.10000000E+01 0.10000000E+01 
0.10000000E+01 
0 


Table 2 


INITIAL COEFFICIENTS FOR R= 0.26582312E-03 

A2 Al B2 BI 
0.10000000E 01 -0.13200034E 01 0.95917120E 00 -0.13700062E 01 
0.10000000E 01 -0.11366976E 01 0.79029629E 00 -0.13095079E 01 
0.10000000E 01 0.30500371E 00 0.43064909E 00 -0.11934469E 01 
GAIN= 0.48525318E-01 ALPHA= 0.51585356E 01 FUNCTION= 0.10317071E 02 


FINAL COEFFICIENTS FOR R= 0.26582312E-03 

A2 Al B2 Bi 
0.10000000E 01 -0.11005577E 01 0.86160736E 00 -0.13928926E 01 
0.10000000E 01 -0.12672789E 01 0.74878288E 00 -0.12533824E 01 
0.10000000E 01 0.44910363E 00 0.42624463E 00 -0.10688564E 01 
GAIN= 0.51341804E-01 ALPHA=-0.15522700E-01 FUNCTION= 0.67633536E-01 


MODIFIED COEFFICIENTS 

0.10000000E 01 -0.11005577E 01 0.86160736E 00 -0.13928926E 01 
0.10000000E 01 -0.12672789E 01 0.74878288E 00 -0.12533824E 01 
0.10000000E 01 0.44910363E 00 0.42624463E 00 -0.10688564E 01 
MODIFIED GAIN= 0.51341804E-01 


GRADIENTS 

0. -0,15056353E 00 0.2761407S5E 00 0.33629320E 00 
0. -0.19561886E 00 0.22825324E 00 0.28943125E 00 
oO. -0,48712567E-01 0.15260250E 00 0.21883522E 00 
377 FUNCTION EVALUATIONS 51 GRADIENT EVALUATIONS 
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Table 2 
(Continued) 


INITIAL COEFFICIENTS FOR R= 0,.26582312E-04 

Al B2 Bi 
0.10000000E 01 -0.11005577E 01 0.86160736E 00 -0.13928926E 01 
0.10000000E 01 -0,12672789E 01 0.74878288E 00 -0.12533824E 01 
0.10000000E 01 0.44910363E 00 0.42624463E 00 -0.10688564E 01 
GAIN= 0.51341804E-01 ALPHA=-0,15522700E-01 FUNCTION=-0.72070768E-02 


FINAL COEFFICIENTS FOR R= 0.26582312E-04 

Al B2 BI 
0.10000000E 01 -0.10786655E 01 0.87831046E 00 -0.13160157E 01 
0.10000000E 01 -0.12562839E 01 0.78747962E 00 -0.12743440E 01 
0.10000000E 01 0.48262715E 00 0.44985502E 00 -0.10219863E 01 
GAIN= 0.72560707E-01 ALPHA=-0,73472910E-01 FUNCTION=-0.47247530E-01 


MODIFIED COEFFICIENTS 

0.10000000E 01 -0.10786655E 01 0.87831046E 00 -0.13160157E 01 
0.10000000E 01 -0.12562839E 01 0.78747962E 00 -0.12743440E 01 
0.10000000E 01 0.48262715E 00 0.44985502E 00 -0.10219863E 01 
MODIFIED GAIN= 0.72560707E-01 


GRADIENTS 

0. -0.35273176E 00 0.53998295E 00 0.72532947E 00 
0. -0.48105144E 00 0.44776873E 00 0.69719212E 00 
. -0.10700078E 00 0.21568865E 00 0.44558926E 00 
198 FUNCTION EVALUATIONS 32 GRADIENT EVALUATIONS 
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INITIAL COEFFICIENTS FOR R= 0.26582312E-05 

A2 Al B2 B1 
0.10000000E 01 -0.10786655E 01 0.87831046E 00 -0.13160157E 01 
0.10000000E 01 -0.12562839E 01 0.78747962E 00 -0.12743440E 01 
0.10000000E 01 0.48262715E 00 0.44985502E 00 -0.10219863E 01 
GAIN= 0.72560707E-01 ALPHA=-0.73472910E-01 FUNCTION=-0.70850371E-01 


FINAL COEFFICIENTS FOR R= 0.26582312E-05 

Al B2 Bi 
0.10000000E 01 -0.10733848E 01 0.87859791E 00 -0.13189261E 01 
0.10000000E 01 -0,12641738E 01 0.78693668E 00 -0.12579032E 01 
0.10000000E 01 0.48517703E 00 0.46097852E 00 -0.10228557E 01 
GAIN= 0.76552721E-01 ALPHA=-0.91377584E-01 FUNCTION=-0.83240161E-01 


MODIFIED COEFFICIENTS 

0.10000000E 01 -0.10733848E 01 0.87859791E 00 -0.13189261E 01 
0.10000000E 01 -0.12641738E 01 0.78693668E 00 -0.12579032E 01 
0.10000000E 01 0.48517703E 00 0.46097852E 00 -0.10228557E 01 
MODIFIED GAIN= 0.76552721E-01 


GRADIENTS 

0. -0,68659899E-01 0.80960995E-01 0.21131991E 00 

Oo. -0.12261476E 00 -0.66190683E-02 0.14751522E 00 

0. -0.11043458E-01 -0.15977386E 00 -0.45411769E-01 
89 FUNCTION EVALUATIONS 12 GRADIENT EVALUATIONS 
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INITIAL COEFFICIENTS FOR R= 0.26582312E-06 

A2 Al B2 Bi 
0.10000000E 01 -0.10733848E 01 0.87859791E 00 -0.13189261E 01 
0.10000000E 01 -0.12641738E 01 0.78693668E 00 -0.12579032E 01 
0.10000000E 01 0.48517703E 00 0.46097852E 00 -0.10228557E 01 
GAIN= 0.76552721E-01 ALPHA=-0.91377584E-01 FUNCTION=-0.90563842E-01 


FINAL COEFFICIENTS FOR R= 0.26582312E-06 

Al B2 BI 
0.10000000E 01 -0.10733774E 01 0.87862835E 00 -0.13189427E 01 
0.10000000E 01 -0,12641572E 01 0.78697857E 00 -0.12578720E 01 
0.10000000E 01 0.48517863E 00 0.46098580E 00 -0.10228711E 01 
GAIN= 0.76564977E-01 ALPHA=-0,96739767E-01 FUNCTION=-0.94341949E-01 
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Table 2 


(Continued) 


MODIFIED COEFFICIENTS 
0.10000000E 01 -0.10733774E 01 
0.10000000E 01 -0.12641572E 01 
0.10000000E 01 0,48517863E 00 

MODIFIED GAIN= 0.76564977E-01 


GRADIENTS 

0. 0.16562078E 01 
Oo. 0.23699104E 01 
0. 0.48901627E 00 
46 FUNCTION EVALUATIONS 


XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXKKXXXXXXXXAXXXAXXXXEXXXXAXXXKXXXXXXXXAK 


0.87862835E 00 -0.13189427E 
0.78697857E 00 -0.12578720E 
0,46098580E 00 -0.10228711E 


-0.25811159E 01 -0.35206183E 

-0.20665732E 01 -0.32827339E 

-0.71702110E 00 -0.19263913E 
4 GRADIENT EVALUATIONS 
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A Program for Designing 
Finite Word-Length IIR Digital Filters 


Kenneth Steiglitz and Bruce D. Ladendorf 


Department of Electrical Engineering and Computer Science 
Princeton University 
Princeton, NJ 08540 


1, Purpose 


This program performs the design of finite word-length IIR digital filters to meet magnitude 
specifications in the frequency domain. 


2. Method 


This program is a somewhat generalized implementation of the algorithm described in [1]. The 
reader is referred to that paper for a detailed problem statement and description of the method. The 
program begins with a set of high precision coefficients for an IIR digital filter in cascade form. This 
filter has been designed by other means, and its magnitude transfer function meets tolerance require- 
ments in pass- and stopbands in the frequency domain. The problem is to design a new filter which 
still meets these requirements but has coefficients with no more than NBIT1 bits after the decimal 
point. The program obtains a starting point by rounding off the high precision coefficients to NBIT1 
bits, and then uses a randomized version of the Hooke and Jeeves search algorithm [2] to optimize the 
coefficients with an initial search increment of NBIT2 bits (NBIT2 < NBIT1). If the final function 
value is no more than 1, the desired tolerances have been met. Because the search algorithm is ran- 
domized, different runs with different settings of the random number initialization, NSET, will in gen- 
eral give different answers, so that the best of several runs may be used. The input data is read in by 
SUBROUTINE INDATA; the heading of that subroutine describes the arrangement of the input data. 
The random number generator used is UNI (see Standards Section). 


3. Program Description 

The program is organized in the following subprograms: 
3.1. MAIN Program 

This is the executive program, which calls the others. The subprograms communicate largely 
through COMMON blocks ABC, RAW, and STEER. ABC has information about the coefficients X 
and other input parameters, such as the desired accuracy. RAW has information about the frequency 
domain specifications — a grid of frequency points is supplied, together with the corresponding desired 
values of the transfer function and tolerances. COMMON block STEER has three logical variables, 
PRINT, TWOPT, and FIXCOF, which determine whether the final results are printed by FUNCT, 
whether two-opt is performed, and whether the second numerator coefficients are fixed at 1, respec- 
tively. After optimization SUBROUTINE FUNCT is called with PRINT = .TRUE., which evaluates 
the transfer function on a finer grid and prints out the final results. 


3.2 SUBROUTINE INDATA 


This subroutine reads in all the problem data; the details are described in its heading. It shares this 
data through COMMON with the other programs. Note that the user should set NTWOPT = 1 to use 
two-opt, and 0 otherwise. 
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3.3 SUBROUTINE FUNCT 


This computes the value of the maximum weighted error function on the coarse grid, and at the 
end, on a finer grid. The constant multiplier of the filter, A, is computed to high precision and not 
quantized. This calculation assumes that the desired transfer function values are 0 or 1; and that the 
weights in all the passbands are equal; otherwise this subroutine must be modified (see Section 4). 


3.4 SUBROUTINE HANDJ 
This is a randomized version of the Hooke and Jeeves Pattern Search. A block diagram is given in 


(1). 
3.5 SUBROUTINE EXPLOR 


This is a local exploration program called by HANDJ; a block diagram is also given in [1]. The local 
exploration is controlled by the logical variables TWOPT and FIXCOF. If TWOPT is .TRUE. then the 
denser two-opt search is performed. If FIXCOF is .TRUE. then the second numerator coefficient in 
each section is frozen at the value 1. 


3.6 SUBROUTINE SET 
This is a program which simply sets one vector equal to another. 
3.7 SUBROUTINE SHUFF 
This program randomly orders the list of coordinates, LIST. It is used by EXPLOR. 


4. Calculations of the Gain Constant 4 


The gain constant A is kept to high precision and not optimized; it is recalculated on the basis of the 
coarse grid each time FUNCT is called, and at the end on the basis of a finer grid. It is important, 
therefore, to have an efficient way of obtaining 4. In this implementation the following heuristic is 
used, which somewhat restricts the class of filters to which the program is applicable. The minimum 
and maximum values of the magnitude of the unnormalized transfer function N/D, Y; and Y2, are cal- 
culated in the passbands only, and A is calculated by 


A =2/(%+Y¥2) 


This centers the magnitude characteristic in the passbands; assuming that the desired transfer function 
values are | in all the passbands (and 0 in all the stopbands), and that the tolerances in the passbands 
are all equal. It is heuristic even with these assumptions because it ignores the error in the stopbands. 
In most cases, however, there is little to be gained by de-centering the magnitude characteristic in the 
passband to reduce the error in the stopband. 


The exact calculation of A requires the solution of a linear program; at each point we write the con- 
straints 


AY — Yq < de 
—(AY-Y¥,) < de 


where Y is the magnitude of N/D, Y, is the desired magnitude characteristic, and d is the tolerance. 
The linear programming problem is to find A and e such that e is a minimum. 


5. Comments 


A. If NCOEF is specified as 4, 4 coefficients per stage are read in, and all of them optimized. If 
NCOEFF is specified as 3, it is assumed that the second numerator coefficient of each section is 
fixed at 1. This is often a reasonable assumption when the filter has stopbands, and has the 
advantages of a simpler filter implementation and an optimization problem with 3*NSECT instead 
of 4*NSECT parameters. 


B. The check mentioned in [1] that the first numerator coefficient be less than 2 in magnitude is 
omitted in FUNCT. Thus it is conceivable that the numerator coefficients become large in magni- 
tude, requiring more bits for their integer parts. 
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6. 


The grid is not generated automatically, but must be read in point by point. Experience has 
shown that it can have as few as 2.5*N points, where N is the number of adjustable parameters in 
the problem, provided that the points are chosen carefully. Since the running time of FUNCT is 
roughly proportional to the number of grid points, it is important to keep this number as small as 
possible. It has been found best to choose the points in clusters near the transition regions, and 
less densely elsewhere. 


The dominant computational burden is the DO 50 loop in FUNCT. This uses a formula close to 
that in [3] and requires 10 multiplication/additions per section per grid point, so the total number 
of such operations in this loop is 10*NSECT*M*KOUNT, where NSECT = number of sections, 
M = number of grid points, and KOUNT = number of function evaluations. Thus, in the test 
problem, NSECT = 4, M = 28, and (for NSET = 100) KOUNT = 3181; so that there are 
3,562,720 multiplications/additions in the DO 50 loop. The total execution time for this problem 
(excluding compilation) was 4.26 seconds, using FORTRAN H on an IBM 360/91; 10.23 seconds 
using FORTRAN G on the same machine; and 38.8 seconds on the Honeywell 6080N. 


Test Problem 
A listing of the program is given in the Appendix. We use example 1 from [1], the bandpass exam- 


ple of Avenhaus and Schuessler [4], as a test example. The filter has the passband [0.411111, 
0.466666]; and stopbands [0.0, 0.383333] and [0.494444, 1.]. The test data is listed in Table 1, and the 
corresponding program output in Table 2. 


The first card (in FORMAT (SI3)) sets 


NCOEF = 3 
NSET = 100 
NTWOPT = 1 
NBIT1 = 6 
NBIT2 = 5 


The next 28 cards establish the grid and weighting, the next card says there are 4 sections, and the 
remaining 12 cards give the high precision coefficients. (See the heading of SUBROUTINE INDATA 
for detailed formatting information.) 


With this value of NSET = 100, the local optimum is found after 3181 function calls, and 


corresponds to a value of F = 0.7681 on the fine grid. 
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3100 


0.36 
0.3658 
0.383333 
0.411111 
0.412 
0.4129 
0.414 
0.4157 
0.4185 
0.423 
0.4275 
0.433 


0, 466666 
0.494444 
0.51 
0.51448 
0.52 
1. 
4 
0.4512 
0.2855: 
0.9116 
-1.0986 
-0.4457 
0.9130) 
-0.0099 
-0.1969 
0.9695 
-0.7304 
-0.5515 
0.9705! 


#aeee INPUT DATA ##e8¢ 


Table 1 
165 
oO. +01 
0. :01 
0. +01 
0. -01 
1 +03 
Ae +03 
ia -03 
SIF 03 
ae +03 
7" 03 
as -03 
t: 03 
an -03 
ti 03 
<r +03 
ila +03 
An +03 
1. +03 
a +03 
ais +03 
ie +03 
i +03 
fe +03 
0. +04 
0. +04 
oO. +01 
0. 01 
0. +04 
591755000000 
823838000000 
860616000000 
945504000000 
342317000000 
786730000000 
665157000000 
016650000000 
353354000000 
169706000000 
388641000000 
899009000000 


Table 2 


NUMBER OF COEFFICIENTS PER STAGE IS 3 


RANDOM INITIALIZATION IS 100 
TWOPT IS 1 


FINAL ( AND INITIAL ROUNDING ) PRECISION IS 6 BITS 


INITIAL SEARCH DELTA IS 5 BIT: 


GRID SPECIFICATIONS 

POINT NO. FREQUENCY 
1 oO. 
2 0.3600000000D 00 
3 0.3658000000D 00 
4 0.3833330016D 00 
5 0.4111110016D 00 
6 0.4120000000D 00 
7 0.4129000000D 00 
8 0.4140000000D 00 
ce 0.4157000000D 00 
10 0.4185000000D 00 
11 0.4230000000D 00 
12 0.4275000000D 00 
13 0.4330000000D 00 
14 0.4386000000D 00 
15 0 .4443000000D 00 
16 0.4500000000D 00 
17 0.4545000000D 00 
18 0.4590000000D 00 
19 0.4619160000D 00 
20 0.4636000000D 00 


‘Ss 


DESIRED Y 


0. 
0. 
0. 
0. 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
0.1000000000D 
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01 
01 
o1 
01 
01 
01 
01 
01 
01 
01 
01 
01 
01 
01 
o1 
01 
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TOLERANCE 
0.1000000000D-01 
0.1000000000D-01 
0.1000000000D-01 
0.1000000000D-01 
0.3000000000D-01 
0.3000000000D-01 
0.3000000000D-01 
0. 3000000000D-01 
0 .3000000000D-01 
0.3000000000D-01 
0.3000000000D-01 
0.3000000000D-01 
0 .3000000000D-01 
0.3000000000D-01 
0.3000000000D-01 
0.3000000000D-01 
0.3000000000D-01 
0. 3000000000D-01 
0.3000000000D-01 
0. 3000000000D-01 
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21 0 .4648329984D 
22 0.4657489984D 
23 0 .4666660032D 
24 0.4944440000D 
25 0.5100000000D 
26 0.5144800000D 
27 0.5200000064D 
28 0.1000000000D 


INITIAL HIGH PRECISION COEFFICIENTS 


SECTION 1 


00 
00 
00 
00 
00 
00 
oo 
01 


Table 2 
(Continued) 


0.1000000000D 01 
0.1000000000D 01 
0.1000000000D 01 
0. 


0.4512591744D 00 0.1000000000D 01 
-0.2855823808D 00 0 .9116860672D 00 
SECTION 2 
-0.1098694544D 01 0.1000000000D 01 
-0.4457342336D 00 0.9130786688D 00 
SECTION 3 
-0.9966515712D-02 0.1000000000D 01 
-0.1969016640D 00 0 .9695353344D 00 
SECTION 4 
-0.7304169664D 00 0.1000000000D 01 
-0,.5515388608D 00 0.9705899008D 00 
THE INITIAL COEFFICIENTS, ROUNDED TO 6 BITS, ARE 
SECTION 1 
0.4531249984D 00 0.100000000QD 01 
-0.2812500000D 00 0 .9062499968D 00 
SECTION 2 
-0.1093750000D 01 0.1000000000D 01 
-0.4531249984D 00 0 .9062499968D 00 
SECTION 3 
-0.1562500000D-01 0.1000000000D 01 
-0.2031250000D 00 0 .9687500032D 00 
SECTION 4 
-0.7343750016D 00 0.1000000000D 01 
-0.5468750016D 00 0.9687500032D 00 
NEXT FOLLOWS A REPORT FROM THE SEARCH ALGORITHM 
NO. CALLS PAT. SIZE . DELTA OLD VALUE 
264 1 0,31250000D-01 0.25259811D 01 
805 1 0.31250000D-01 0.17236617D 01 
1602 1 0,15625000D-01 0.17160663D 01 
2126 1 0.15625000D-01 0.94060213D 00 
2650 1 0.15625000D-01 0.73309429D 00 


FINAL VALUES- NO. OF FUNCT CALLS= 


3181 FUNCT= 


THE FINAL COEFFICIENTS, HAVING 6 BITS, ARE 


SECTION 1 
0.4375000000D 00 
«2812500000D 00 
SECTION 2 
-0.1093750000D 01 
-0.4531249984D 00 
SECTION 3 
-0.1562500000D-01 
-0.1875000000D 00 
SECTION 4 
-0.7343750016D 00 
-0.5625000000D 00 


***ee FINAL RESULTS *##++ 
THE CONSTANT A IS 


FUNCTION VALUE ON COARSE GRID IS 


0.1000000000D 
0 .9062499968D 


0.1000000000D 
0 .9687500032D 


0.1000000000D 
0 .9687500032D 


0.1000000000D 01 
0 .9062499968D 


00 


01 
00 


01 
00 


o1 
00 


0 .7493357696D-02 
0.7193585600D 00 


0.3000000000D-01 
0.3000000000D-01 
0.3000000000D-01 
0.1000000000D-01 
0.1000000000D-01 
0.1000000000D-01 
0.1000000000D-01 
0.1000000000D-01 


FOR 4 SECTIONS ARE 


NEW VALUE 
0.17236617D 01 
0.17160663D 01 
0.94060213D 00 
0.73309429D 00 
0.71935856D 00 


0.7193585600D 00 


FREQUENCY DESIRED Y ACTUAL Y ERROR 
0. 0. 0.70283624D-02 0.70283624D 00 
0.36000000D 00 oO. 0.64137194D-02 0.64137194D 00 
0.36580000D 00 oO. 0.67483316D-02 0.67483316D 00 
0.38333300D 00 0. 0.52589518D-02 0.52589518D 00 
0.41111100D 00 0.10000000D 01 0.10215808D 01 0.71935856D 00 
0.41200000D 00 0.10000000D 01 0.10204763D 01 0.68254401D 00 
0.41290000D 00 0.10000000D 01 0.10148222D 01 0.49407221D 00 
0.41400000D 00 0.10000000D 01 0.10066453D 01 0.22150962D 00 
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0.41570000D 
0.41850000D 
0.42300000D 
0.42750000D 
0.43300000D 
0.43860000D 
0.44430000D 
0.45000000D 
0.45450000D 
0.45900000D 
0.46191600D 
0.46360000D 
0.46483300D 
0.46574900D 
0.46666600D 
0.49444400D 
0.51000000D 
0.51448000D 
0.52000000D 
0.10000000D 


FINAL RESULTS 


FREQUENCY 
***** BAND FROM GRID POINT 


oO. 


0.36000000D- 
0.72000000D- 


0.10800000D 
0.14400000D 
0.18000000D 
0.21600000D 
0.25200000D 
0.28800000D 
0.32400000D 


***** BAND FROM GRID POINT 


0.36000000D 
0.36058000D 
0.36116000D 
0..36174000D 
0. 36232000D 
0.36290000D 
0. 36348000D 
0.36406000D 
0.36464000D 
0.36522000D 


*#**** BAND FROM GRID POINT 


0.36580000D 
0.36755330D 
0 .36930660D 
0.37105990D 
0.37281320D 
0.37456650D 
0.37631980D 
0.37807310D 
0.37982640D 
0.38157970D 
0. 38333300D 


*#*e** BAND FROM GRID POINT 


0.41111100D 
0.41119990D 
0.41128880D 
0.41137770D 
0.41146660D 
0.41155550D 
0.41164440D 
0 .41173330D 
0.41182220D 
0.41191110D 


***** BAND FROM GRID POINT 
0.41200000D 00 0.10000000D 
0.41209000D 00 0.10000000D 


0.41218000D 


0.78030010D- 
0 .89844010D- 


0.45334529D 
0.53860584D 
0.10947098D 
0.47081791D 


0.14235485D- 


0.51437758D 


0.70790976D- 


0.71935856D 
0.70546071D 
0.35736149D 


0.14933567D- 


0.17460133D 
0.15088357D 
0 .53608885D 
0.70073326D 
0.71485085D 
0.67435740D 
0.70871288D 


01 
01 
00 
00 
00 
00 
01 
00 
01 
00 
00 
00 
01 


ERROR 


0.70355889D 
0.70067577D 
0.69162904D 
0.67511103D 
0 .64849851D 
0.60693616D 
0 .54133609D 
0.43383098D 
0.24698003D 


0.98742474D- 


0.64203139D 
0 .64798328D 
0.65348297D 
0 .65848927D 
0.66295783D 
0 .66684091D 
0.67008707D 
0 .67264089D 
0.67444262D 
0 .67542784D 


0.67552702D 
0.66964453D 
0.65250871D 
0 .62103614D 
0.57130142D 
0 .49827854D 
0.39549038D 
0.25452870D 


0.64388579D- 


0.18946638D 
0.52643590D 


0.75437147D 
0.76185765D 
0.76636676D 
0.76809520D 
0.76723329D 
0.76396509D 
0.75846824D 
0.75091390D 
0.74146667D 
0.73028457D 


0.71751907D 
0.70313092D 
0.68741216D 


Table 2 
(Continued) 
00 0.10000000D 01 0.99765911D 00 
00 0.10000000D 01 0.99730467D 00 
00 0,10000000D 01 0.10136004D 01 
00 0.10000000D 01 0.10161582D 01 
00 0.10000000D 01 0.99671587D 00 
00 0.10000000D 01 0.98587546D 00 
00 0.10000000D 01 0.10004271D 01 
00 0.10000000D 01 0.10154313D 01 
00 0.10000000D 01 0.10021237D 01 
00 0.10000000D 01 0.97841925D 00 
00 0.10000000D 01 0.97883618D 00 
00 0.10000000D 01 0.98927915D 00 
00 0.10000000D 01 0.99955200D 00 
00 0.10000000D 01 0.10052380D 01 
00 0.10000000D 01 0.10045265D 01 
oo oO. 0 .53608885D-02 
00 Oo. 0. 70073326D-02 
00 oO. 0.71485085D-02 
00 0. 0.67435740D-02 
01 0. 0.70871288D-02 
ON FINE GRID- 10 POINTS PER GRID POINT 

DESIRED ¥ ACTUAL ¥ 

1 TO 2 seeee 
0. 0.70355889D-02 
01 0. 0.70067577D-02 
01 0. 0 .69162904D-02 
00 0. 0.67511103D-02 
oo oO. 0 .64849851D-02 
00 0. 0. 60693616D-02 
00 Oo. 0 .54133609D-02 
oo oO. 0.43383098D-02 
00 oO. 0.24698003D-02 
00 0. 0.98742474D-03 

270 3 sees 
oo oO. 0.64203139D-02 
00 0. 0.64798328D-02 
00 0. 0.65348297D-02 
oo oO. 0 .65848927D-02 
00 0. 0.66295783D-02 
00 Oo. 0 .66684091D-02 
oo Oo. 0.67008707D-02 
00 0. 0 .67264089D-02 
00 0. 0.67444262D-02 
oo oO. 0 .67542784D-02 

3TO 4 #eene 
00 oO. 0 .67552702D-02 
00 0. 0.66964453D-02 
00 0. 0 .65250871D-02 
00 0. 0 .62103614D-02 
00 0. 0.57130142D-02 
00 0. 0 .49827854D-02 
00 0. 0. 39549038D-02 
00 0. 0.25452870D-02 
00 0. 0.64388579D-03 
oo oO. 0 .18946638D-02 
oo oO. 0.52643590D-02 

5 TO 6 sseee 
00 0.10000000D 01 0.10226311D 01 
00 0.10000000D 01 0.10228557D 01 
00 0.10000000D 01 0.10229910D 01 
00 0.10000000D 01 0.10230429D 01 
00 0.10000000D 01 0.10230170D 01 
00 0.10000000D 01 0.10229190D 01 
00 0.10000000D 01 0.10227540D 01 
00 0.10000000D 01 0.10225274D 01 
00 0.10000000D 01 0.10222440D 01 
00 0.10000000D 01 0.10219085D 01 

6 TO 7 ##ee« 
01 0.10215256D 01 
01 0.10210939D 01 
00 0.10000000D 01 0.10206224D 01 
01 0.10201150D 01 


0.41227000D 00 0.10000000D 
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0.67049975D 


00 
00 
00 
00 
00 
00 
00 
00 
00 
01 


00 
00 
00 
00 
00 
00 
00 
00 
00 
00 


00 
00 
oo 
oo 
00 
00 
00 
00 
01 
00 
oo 


00 
00 
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Table 2 
(Continued) 
0.41236000D 00 0.10000000D 01 0.10195757D 
0.41245000D 00 0.10000000D 01 0.10190083D 
0.41254000D 00 0.10000000D 01 0.10184162D 
0.41263000D 00 0.10000000D 01 0.10178028D 
0.41272000D 00 0.10000000D 01 0.10171713D 
0.41281000D 00 0.10000000D 01 0.10165246D 
**s++ BAND FROM GRID POINT 7 TO 8 ##### 
0.41290000D 00 0.10000000D 01 0.10158656D 
0.41301000D 00 0.10000000D 01 0.10150473D 
0.41312000D 00 0.10000000D 01 0.10142192D 
0.41323000D 00 0.10000000D 01 0.10133853D 
0.41334000D 00 0.10000000D 01 0.10125497D 
0.41345000D 00 0.10000000D 01 0.10117159D 
0.41356000D 00 0.10000000D 01 0.10108873D 
0.41367000D 00 0.10000000D 01 0.10100667D 
0.41378000D 00 0.10000000D 01 0.10092570D 
0.41389000D 00 0.10000000D 01 0.10084608D 
++ee* BAND FROM GRID POINT 8 TO 9 ###4# 
0.41400000D 00 0.10000000D 01 0.10076803D 
0.41417000D 00 0.10000000D 01 0.10065098D 
0.41434000D 00 0.10000000D 01 0.10053884D 
0.41451000D 00 0.10000000D 01 0.10043218D 
0.41468000D 00 0.10000000D 01 0.10033147D 
0.41485000D 00 0.10000000D 01 0.10023710D 
0.41502000D 00 0.10000000D 01 0.10014936D 
0.41519000D 00 0.10000000D 01 0.10006849D 
0.41536000D 00 0.10000000D 01 0.99994657D 
0.41553000D 00 0.10000000D 01 0.99927970D 
++ee* BAND FROM GRID POINT 9 TO 10 sees 
0.41570000D 00 0.10000000D 01 0.99868488D 
0.41598000D 00 0.10000000D 01 0.99786248D 
0.41626000D 00 0.10000000D 01 0.99723406D 
0.41654000D 00 0.10000000D 01 0.99679534D 
0.41682000D 00 0.10000000D 01 0.99654003D 
0.41710000D 00 0.10000000D 01 0.99646012D 
0.41738000D 00 0.10000000D 01 0.99654624D 
0.41766000D 00 0.10000000D 01 0.99678792D 
0.41794000D 00 0.10000000D 01 0.99717386D 
0.41822000D 00 0.10000000D 01 0.99769208D 
*ees* BAND FROM GRID POINT 10 TO 11 ###4* 
0.41850000D 00 0.10000000D 01 0.99833011D 
0.41895000D 00 0.10000000D 01 0.99957423D 
0.41940000D 00 0.10000000D 01 0.10010407D 
0.41985000D 00 0.10000000D 01 0.10026754D 
0.42030000D 00 0.10000000D 01 0.10044248D 
0.42075000D 00 0.10000000D 01 0.10062374D 
0.42120000D 00 0.10000000D 01 0.10080639D 
0.42165000D 00 0.10000000D 01 0.10098581D 
0.42210000D 00 0.10000000D 01 0.10115775D 
0.42255000D 00 0.10000000D 01 0.10131836D 
*eeee BAND FROM GRID POINT 11 TO 12 sees 
0.42300000D 00 0.10000000D 01 0.10146425D 
0.42345000D 00 0.10000000D 01 0.10159251D 
0.42390000D 00 0.10000000D 01 0.10170070D 
0.42435000D 00 0.10000000D 01 0.10178694D 
0.42480000D 00 0.10000000D 01 0.10184982D 
0.42525000D 00 0.10000000D 01 0.10188847D 
0.42570000D 00 0.10000000D 01 0.10190250D 
0.42615000D 00 0.10000000D 01 0.10189199D 
0.42660000D 00 0.10000000D 01 0.10185744D 
0.42705000D 00 0.10000000D 01 0.10179979D 
#**#¢ BAND FROM GRID POINT 12 TO 13 #eeee 
0.42750000D 00 0.10000000D 01 0.10172030D 
0.42805000D 00 0.10000000D 01 0.10159582D 
0.42860000D 00 0.10000000D 01 0.10144452D 
0.42915000D 00 0.10000000D 01 0.10127028D 
0.42970000D 00 0.10000000D 01 0.10107730D 
0.43025000D 00 0.10000000D 01 0.10087000D 
0.43080000D 00 0.10000000D 01 0.10065288D 
0.43135000D 00 0.10000000D 01 0.10043042D 
0.43190000D 00 0,.10000000D 01 0.10020702D 
0.43245000D 00 0.10000000D 01 0.99986912D 
*#*#*s BAND FROM GRID POINT 13 TO 14 #eeae 
6.4-7 


0.65252410D 
0.63360920D 
0 .61387271D 
0.59342618D 
0.57237521D 
0.55081958D 


0.52885347D 
0.50157765D 
0.47397244D 
0.44617820D 
0.41832464D 
0.39053136D 
0.36290838D 
0.33555656D 
0.30856820D 
0.28202742D 


0.25601064D 
0.21699227D 
0.17961268D 
0.14406032D 
0.11049151D 


0.79033543D- 
0.49787442D- 
0.22830594D- 
0.17808973D-' 
0.24010040D- 


0.43836976D- 
0.71250407D-' 
0.92198169D- 


0.10682197D 
0.11533237D 
0.11799615D 
0.11512560D 
0.10706939D 


0.94204776D- 
0.76930922D- 


0 .55663123D-' 
0.14192199D- 
0 .34690503D-' 
0.89178679D- 


0.14749376D 
0.20791344D 
0 .26879637D 
0.32860352D 
0.38591673D 
0.43945445D 


0.48808469D 
0.53083512D 
0.56690020D 
0.59564508D 
0.61660646D 
0.62949036D 
0.63416685D 
0 .63066217D 
0.61914826D 
0 .59993034D 


0.57343289D 
0.53193950D 
0.48150652D 
0.42342644D 
0.35910105D 
0.29000047D 
0.21762531D 
0.14347290D 


0.69007842D- 
0.43628569D- 


01 
01 
01 
02 
01 


01 
01 
01 
00 
00 
00 
00 
00 
01 
01 


01 
01 
01 
01 
00 
00 
00 
00 
00 
00 


00 
01 
02 


FWIIR 


IIR Programs 


Table 2 
(Continued) 
0.43300000D 00 0.10000000D 01 0.99774069D 
0.43356000D 00 0.10000000D 01 0.99568654D 
0.43412000D 00 0.10000000D 01 0.99378179D 
0.43468000D 00 0.10000000D 01 0.99205839D 
0.43524000D 00 0.10000000D 01 0.99054424D 
0.43580000D 00 0.10000000D 01 0.98926318D 
0.43636000D 00 0.10000000D 01 0.98823476D 
0.43692000D 00 0.10000000D 01 0.98747431D 
0.43748000D 00 0.10000000D 01 0.98699283D 
0.43804000D 00 0.10000000D 01 0.98679699D 
‘see% BAND FROM GRID POINT 14 TO 15 sss 
0.43860000D 00 0.10000000D 01 0.98688913D 
0.43917000D 00 0.10000000D 01 0.98727659D 
0.43974000D 00 0.10000000D 01 0.98795361D 
0.44031000D 00 0.10000000D 01 0.98890878D 
0.44088000D 00 0.10000000D 01 0.99012605D 
0.44145000D 00 0.10000000D 01 0.99158467D 
0.44202000D 00 0.10000000D 01 0.99325934D 
0.44259000D 00 0.10000000D 01 0.99512014D 
0.44316000D 00 0.10000000D 01 0.99713278D 
0.44373000D 00 0,10000000D 01 0.99925879D 
‘see BAND FROM GRID POINT 15 TO 16 #aee* 
0.44430000D 00 0,10000000D 01 0.10014557D 
0.44487000D 00 0.10000000D 01 0.10036776D 
0.44544000D 00 0.10000000D 01 0.10058758D 
0.44601000D 00 0.10000000D 01 0.10079990D 
0.44658000D 00 0.10000000D 01 0.10099947D 
0.44715000D 00 0.10000000D 01 0.10118103D 
0.44772000D 00 0.10000000D 01 0.10133937D 
0.44829000D 00 0.10000000D 01 0.10146952D 
0.44886000D 00 0.10000000D 01 0.10156687D 
0.44943000D 00 0.10000000D 01 0.10162735D 
“see BAND FROM GRID POINT 16 TO 17 s#ee« 
0.45000000D 00 0.10000000D 01 0.10164754D 
0.45045000D 00 0.10000000D 01 0.10163331D 
0.45090000D 00 0.10000000D 01 0.10159152D 
0.45135000D 00 0.10000000D 01 0.10152176D 
0.45180000D 00 0.10000000D 01 0.10142406D 
0.45225000D 00 0.10000000D 01 0.10129894D 
0.45270000D 00 0.10000000D 01 0.10114742D 
0.45315000D 00 0.10000000D 01 0.10097101D 
0.45360000D 00 0.10000000D 01 0.10077177D 
0.45405000D 00 0.10000000D 01 0.10055223D 
*seee BAND PROM GRID POINT 17 TO 18 #40 
0.45450000D 00 0.10000000D 01 0.10031541D 
0.45495000D 00 0.10000000D 01 0.10006481D 
0.45540000D 00 0.10000000D 01 0.99804357D 
0.45585000D 00 0.10000000D 01 0.99538348D 
0.45630000D 00 0.10000000D 01 0.99271450D 
0.45675000D 00 0.10000000D 01 0.99008619D 
0.45720000D 00 0.10000000D 01 0.98755054D 
0.45765000D 00 0.10000000D 01 0.98516140D 
0.45810000D 00 0.10000000D 01 0.98297383D 
0.45855000D 00 0.10000000D 01 0.98104336D 
‘sees BAND FROM GRID POINT 18 TO 19 ##ee« 
0.45900000D 00 0.10000000D 01 0.97942525D 
0.45929160D 00 0.10000000D 01 0.97856902D 
0.45958320D 00 0.10000000D 01 0.97788085D 
0.45987480D 00 0.10000000D 01 0.97737438D 
0.46016640D 00 0.10000000D 01 0.97706251D 
0.46045800D 00 0.10000000D 01 0.97695714D 
0.46074960D 00 0.10000000D 01 0.97706901D 
0.46104120D 00 0.10000000D 01 0.97740730D 
0.46133280D 00 0.10000000D 01 0.97797941D 
0.46162440D 00 0.10000000D 01 0.97879041D 
ssees BAND FROM GRID POINT 19 TO 20 ses 
0.46191600D 00 0.10000000D 01 0.97984262D 
0.46208440D 00 0.10000000D 01 0.98055988D 
0.46225280D 00 0.10000000D 01 0.98135653D 
0.46242120D 00 0.10000000D 01 0.98223124D 
0.46258960D 00 0.10000000D 01 0.98318216D 
0.46275800D 00 0.10000000D 01 0.98420682D 
0.46292640D 00 0.10000000D 01 0.98530202D 


6.4-8 


0.75310269D-01 
0.14378228D 00 
0.20727361D 00 
0.26472054D 00 
0.31519196D 00 
0.35789432D 00 
0.39217477D 00 
0.41752302D 00 
0.43357239D 00 
0.44010034D 00 


0.43702874D 00 
0.42411345D 00 
0.40154633D 00 
0.36970726D 00 
0.32913181D 00 
0.28051073D 00 
0.22468875D 00 
0.16266201D 00 
0 .95573713D-01 
0.24707332D-01 


0.48523386D-01 
0.12258821D 00 
0.19585872D 00 
0.26663173D 00 
0.33315810D 00 
0.39367734D 00 
0.44645757D 00 
0.48984066D 00 
0.52229130D 00 
0.54244880D 00 


0.54917973D 00 
0.54443719D 00 
0.53050826D 00 
0.50725415D 00 
0.47468723D 00 
0.43298007D 00 
0.38247160D 00 
0.32367061D 00 
0.25725621D 00 
0.18407528D 00 


0.10513703D 00 
0.21604847D-01 
0.65214538D-01 
0.15388379D 00 
0.24284985D 00 
0.33046045D 00 
0.41498217D 00 
0.49462008D 00 
0.56753911D 00 
0 .63188776D 00 


0.68582494D 00 
0.71436620D 00 
0.73730509D 00 
0.75418718D 00 
0.76458304D 00 
0.76809520D 00 
0.76436645D 00 
0.75308967D 00 
0.73401947D 00 
0.70698625D 00 


0.67191280D 00 
0.64800384D 00 
0.62144912D 00 
0.59229199D 00 
0.56059447D 00 
0 .52643932D 00 
0.48993239D 00 
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0.46309480D 
0,.46326320D 


00 
00 


Table 2 
(Continued) 


0.10000000D 
0.10000000D 


01 
01 


0.46343160D 00 0.10000000D 01 
***** BAND FROM GRID POINT 


0.46360000D 
0.46372330D 
0 .46384660D 
0.46396990D 
0 .46409320D 
0.46421650D 
0.46433980D 
0,46446310D 
0 .46458640D 
0.46470970D 


oo 


0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 


***** BAND FROM GRID POINT 


0.46483300D 
0 .46492460D 
0.46501620D 
0.46510780D 
0.46519940D 
0.46529100D 
0.46538260D 
0 .46547420D 
0.46556580D 
0.46565740D 


00 


0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 


***** BAND FROM GRID POINT 


0.46574900D 
0.46584070D 
0.46593240D 
0.46602410D 
0 .46611580D 
0.46620750D 
0 .46629920D 
0.46639090D 
0 .46648260D 
0.46657430D 
0 .46666600D 


00 


0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 
0.10000000D 


***** BAND FROM GRID POINT 


0.49444400D 
0.49599960D 
0.49755520D 
0.49911080D 
0.50066640D 
0.50222200D 
0.50377760D 
0.50533320D 
0.50688880D 
0.50844440D 


00 
00 


00 


***e** BAND FROM GRID POINT 


0.51000000D 
0.51044800D 
0.51089600D 
0.51134400D 
0.51179200D 
0.51224000D 
0.51268800D 
0.51313600D 
0.51358400D 
0.51403200D 


***** BAND FROM GRID POINT 


0.51448000D 
0.51503200D 
0.51558400D 
0.51613600D 
0.51668800D 
0.51724000D 
0.51779200D 
0.51834400D 
0.51889600D 
0.51944800D 


00 
00 
00 
00 
oo 
00 
00 
00 
00 
00 


QO. 
QO. 


0 .98646385D 00 
0.98768750D 00 
0 .98896724D 00 


20 TO 21 #eeee 


01 
01 
01 
01 
o1 
01 
or 
o1 
01 
01 
21 TO 


01 
22 TO 
01 
01 
01 
01 


01 


0.99029633D 00 
0.99129625D 00 
0 .99231493D 00 
0.99334844D 00 
0.99439249D 00 
0.99544236D 00 
0.99649286D 00 
0.99753830D 00 
0.99857251D 00 
0.99958876D 00 
22 seeee 
0.10005797D 01 
0.10012949D 01 
0.10019884D 01 
0.10026564D 01 
0.10032952D 01 
0.10039007D 01 
0.10044686D 01 
0.10049945D 01 
0.10054736D 01 
0.10059010D 01 
23 seene 
0.10062716D 01 
0.10065804D 01 
0.10068212D 01 
0.10069882D 01 
0.10070755D 01 
0.10070767D 01 
0.10069855D 01 
0.10067950D 01 
0.10064986D 01 
0.10060891D 01 
0.10055594D 01 


24 TO 25 seeee 


0 .53664005D-02 
0.23290146D-02 
0.57134124D-04 
0.19262916D-02 
0 .33826998D-02 
0.45079746D-02 
0 .53664970D-02 
0.60093980D-02 
0 .64775363D-02 
0.68037441D-02 


25 TO 26 seeee 


26 TO 


***** BAND FROM GRID POINT 27 TO 
0.52000000D 00 o. 


0.56800000D 


00 


0. 


6.4-9 


0.70145375D-02 
0.70569896D-02 
0.70921265D-02 
0.71203702D-02 
0.71421190D-02 
0.71577488D-02 
0.71676144D-02 
0.71720504D-02 
0.71713735D-02 
0 .71658821D-02 
27 sees 
0.71558586D-02 
0.71376699D-02 
0.71134734D-02 
0.70837068D-02 
0.70487784D-02 
0.70090696D-02 
0 .69649370D-02 
0.69167132D-02 
0 .68647096D-02 
0.68092172D-02 
28 xeeax 
0.67505077D-02 
0.22088895D-03 


0.45120503D 00 
0.41041687D 00 
0.36775870D 00 


0.32345566D 00 
0.29012479D 00 
0.25616929D 00 
0.22171894D 00 
0.18691706D 00 
0.15192135D 00 
0.11690478D 00 
0.82056549D-01 
0.47582919D-01 
0.13708201D-01 


0.19324343D-01 
0 .43164152D-01 
0.66279129D-01 
0 .88547527D-01 
0.10984092D 00 
0.13002403D 00 
0.14895458D 00 
0.16648317D 00 
0.18245317D 00 
0.19670060D 00 


0.20905412D 00 
0.21934500D 00 
0.22737191D 00 
0.23294069D 00 
0.23584995D 00 
0.23589117D 00 
0.23284891D 00 
0.22650112D 00 
0.21661944D 00 
0.20296961D 00 
0.18531197D 00 


0.53664005D 00 
0.23290146D 00 
0.57134124D-02 
0.19262916D 00 
0.33826998D 00 
0.45079746D 00 
0.53664970D 00 
0.60093980D 00 
0.64775363D 00 
0.68037441D 00 


0.70145375D 00 
0.70569896D 00 
0.70921265D 00 
0.71203702D 00 
0.71421190D 00 
0.71577488D 00 
0.71676144D 00 
0.71720504D 00 
0.71713735D 00 
0.71658821D 00 


0.71558586D 00 
0.71376699D 00 
0.71134734D 00 
0.70837068D 00 
0.70487784D 00 
0.70090696D 00 
0 .69649370D 00 
0.69167132D 00 
0.68647096D 00 
0.68092172D 00 


0.67505077D 00 
0.22088895D-01 
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Table 2 
(Continued) 
0.61600000D 00 0. 0.31906682D-02 0.31906682D 00 
0.66400000D 00 0. 0.48591221D-02  0.48591221D 00 
0.71200000D 00 0. 0.57711975D-02 0.57711975D 00 
0.76000000D 00 0. 0.63127353D-02 0.63127353D 00 


-66508561D-02 0.66508561D 00 
-68657264D-02 0.68657264D 00 
-69986081D-02 0.69986081D 00 
«70712714D-02 0.70712714D 00 
+70944158D-02 0.70944158D 00 


0.80800000D 00 oO. 
0.85600000D 00 Oo. 
0.90400000D 00 oO. 
0.95200000D 00 Oo. 
0.10000000D 01 O 


e°2000 


THE VALUE OF A FROM THE FINE GRID IS 0.7501062336D-02 


THE FINAL VALUE OF THE ERROR ON THE FINE GRID IS 0.7680951936D 00 


6.4-10 
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Section 6.4 


INQOX ‘W ‘LHOIGM ‘A ‘M /MVH/ NOWWOD 

N “LOGSN ‘ZLIGN ‘LLIGN ‘IdOMIN ‘LESN *X /28V/ NOWWOD 
A40OXId ‘LdOML *LNTYd TVOIDO1 

(9€)X ‘(00L)“HOTaM *(001)A *(00L)M NOTSIOg¥d aTENOG 
VLVGNI 3NILNOwsAS 


“NEZOWd GNV | OL JS SI LNIDIdagOD YOLVYSWON GNODES BHL D 

“NOILOSS Wad SINZIOIa&90O € dO ASVD AHL NI * 6°ST°LOESN ‘NOILOGS 2 
Yad SINZIOIdag0O } YO £ FUV SUSHL UAHLAHM NO ONIGNGdgq ‘NI avay 3 
SINAIDI4agOD LOGSN*} YO LOASN*€ SUV AYSHL *(Z-)**Z 40 LNEIDIAAGOD 
MOLVNIWONAG ‘({-)**Z 40 INZIDI44909 YOLYNIWONSG *(NOILOES uaa 2 


b aI) (2-)**Z 40 INAIOIGA90D YOLVYAWAN ‘({-)**Z dO LNAIDIGaEO 9 
MOLVYSWON ?YSqHO FHL NI SUV AZHL NOILOGS HOV NIHLIM ‘Ola *Z NOILOGS 9 
XN ‘'“SYId NSAIO SUV | NOILOGS HOd SLNAIDI4aGOD BHL “GV. O 

Yad ANO ‘SINSIOIG490 ,NOISIOGUd ALINIGNI, SHL JAVH SGUVD LXEN GHL 9 
2 

“LOUSN ‘SNOILOSS YAqNO-GNOOSS 40 USEWAN SHL SVH GUVD LX3N SHL 9 

FP) 

“SONVUSIOL GWVS ZHL GNV ‘| 3NIVA aauISad SvH 3 

GNVa SSVd AUSAG GNV ‘SGNVa dOLS GNV SSVd AINO SVH Y3LTId 3HL ‘SI 9 
LVHL “| YO 0 SNIVA 3H“ AINO NO SSXVL NOILONNA YSaSNVYL GTXISaG 3 
SHL LVHL NOILVINOIVD V GHL YOd SAWASSV LONN4 SNILQOWGNS LNESSYd FHL O 
* OOL'SI‘W *G3LNNOD Suv SUV W SHL ‘| dO KONSNOAYA V AAIOTdS OD 
*“SINIOd GI¥S SHL JO ONS GHL ALVOIGNI OL “SONVUAIOL SHL O 

GUIHL GNV ‘SGNLINOVW NOILONNA W34SNVEL GaYISEC JHL LXaN ‘ADNENOTYA O 
ESINOAN GHL 40 SNOILOVHd NI AONANOGYA SHL LSYIA SVH GuYVD HOVE O 

'dUVO Wad LNIOd GI¥) SNO ‘GIND HL SAId4IOGdS SGYVD 40 LES LX3N HL O 
2 

“WHLIMOSTY S3A3al GNY 3XO0H 9 

SHL YOd (SLIG NI ) VLIGd HOUVES IVILINI SHL GNV ‘SLNZIOIdag09 9 

GHL 40 HLONI JIG GaNISad 3HL ‘(SSX SI | ‘ON SI 0 ) GaSN aa aTNOHS OD 
“dO-OML MSHLEHM *HYOLVYSNSD UAGWON WOGNVY 3HL dO ONILLGS IVILINI 9 

SHL ‘(¥ YO £ ) SOVES Usd SENIQIAaGOO 40 YAGWAN ZHL SVH | GuVD 2 
'VLVd WH1G0d ZHL NI SGVaM ANILNOWENS SITHL 2 

VIVONI INTLAOWEAS 3 
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CHAPTER 7 


Cepstral Analysis 


A. V. Oppenheim 


Introduction 


This section consists of two programs related to the computation of the cepstrum and the generation 
of the minimum phase equivalent of a nonminimum phase signal. The cepstrum method is a nonlinear 
signal analysis technique which has found application to a variety of problem areas including echo 
detection [1], speech analysis [2], geophysical data processing [3] and a variety of others. Computation 
of the cepstrum is also an intermediate step in homomorphic filtering for deconvolution [4]. 


The cepstrum is defined as the inverse Fourier transform of the logarithm of the Fourier transform 
of the input sequence and, in general, this requires the evaluation of the phase as a continuous function 
of frequency. This in turn requires computation of an "unwrapped" phase, i.e., a phase curve for which 
the discontinuities associated with computation of the phase modulo 27 are removed. The cepstrum 
obtained in this manner is referred to as the complex cepsirum since it requires the use of the complex 
logarithm. 


An alternative form of the cepstrum is based on the use of the logarithm of the magnitude rather 
than the complex logarithm of the Fourier transform. This form of the cepstrum is often referred to as 
the real cepstrum. For a minimum phase signal the complex cepstrum is easily obtained from this form 
of the cepstrum by simple windowing in the cepstral domain and the need for phase unwrapping is 
thereby eliminated. Computation of the cepstrum using only the magnitude of the Fourier transform 
followed by appropriate windowing in the cepstral domain and the inverse cepstral transformation also 
provides a means of transforming a signal to its minimum-phase equivalent. A discussion of the 
theoretical details can be found in Oppenheim and Schafer [4]. 


This section contains two programs related to cepstral analysis. The first program is directed at the 
computation of the complex cepstrum and contains as a major component the program for phase 
unwrapping. It should be noted that the phase unwrapping program included in Section 7.1 has many 
other applications in addition to its importance in cepstral analysis. For example, phase unwrapping 
arises in the context of tracking propagation times in the ocean using sinusoidal sources. The second 
program computes the real cepstrum and implements the appropriate windowing and inverse transfor- 
mation to obtain the minimum-phase reconstruction of the signal. In applying these programs and cep- 
stral analysis in general, it is often important to avoid data which has been oversampled since this will 
introduce a frequency band with small amplitudes and low signal-to-noise ratio which will lead to 
unreliable phase unwrapping and will tend to dominate the cepstrum because of the logarithmic 
transformation. Thus the use of modulation and decimation/interpolation filtering may be required 
prior to cepstral analysis. This and a variety of other computational issues and concerns are discussed 
in detail in Tribolet [3]. 
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Computation of the Complex Cepstrum 


J. M. Tribolet 


Instituto Superior Tecnico 
Lisbon, Portugal 


and 


T. F. Quatieri 


Massachusetts Institute of Technology 
Cambridge, MA 02139 


1. Purpose 

The program is designed to compute the complex cepstrum X(n) of a real sequence x(n). The 
complex cepstrum is defined as the inverse Fourier transform of the complex logarithm of the Fourier 
transform of the input sequence. 


2. Method 


The complex cepstrum %[n] of a real sequence x[n] is evaluated by means of the DFT computa- 
tional realization as discussed by Oppenheim and Schafer [1] 


&[n] = IDFT (logIDFT(x{[])]) ( 


where the DFT length is sufficient to avoid cepstral aliasing. The complex logarithmic operation 
involved in this computation makes it necessary to evaluate the phase of x[n] as a continuous function 
in frequency. This evaluation, called phase unwrapping, is accomplished by means of the adaptive 
numerical integration algorithm proposed by Tribolet [2]. This technique uses both the principal value 
of the phase and the phase derivative to compute the unwrapped phase at each frequency. The evalua- 
tion of the phase derivative requires the knowledge of the DFTs of both x(n) and nx(n). 


The basic idea of the phase unwrapping algorithm is the following: Let 1, be an arbitrary frequency 
value, ARGIX(e!™)] be the principle value of the phase, arglX(e’ ")] be the unwrapped phase, and 
arg ix(e® ')] the phase derivative at 2. The set of permissible phase values at , is given by 


{ARGIx(2™)] + 2m, | integer) (2) 
The phase unwrapping problem amounts to determining the correct integer value /.(,) such that 
arg X(e!™)] = ARGIX(e’™)] + 27 1.(0)) « (3) 


This is done through the use of numerical integration of the phase derivative. We adopt here the tra- 
pezoidal integration rule. Assuming Li unwrapped phase to be known at a frequency No < 9, we 
define a phase estimate at 0), arg (X(e 1) 106] by 


arg(X(e/")| Qo] = arglx(e/™)] + a lare'{X(e’™)] + arg'[X(e’™)}] . (4) 
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Clearly, this estimate improves as the step interval AM = 2, — Qo becomes smaller. We define the 
phase estimate at 9, to be consistent if it lies within a predefined distance of one of the permissible 
phase values at ,, that is, if there exists an /.() such that 


larg lX(e!™) |g] — ARGLX(e!™)] + 21,(9,)|<THLCON<z . (5) 


The basic idea of this algorithm is thus to adapt the step size AQ until a consistent phase estimate is 
found. The resultant /.(,) in Eq. (5) is used in Eq. (3) to form the unwrapped phase at 2. This 
unwrapped phase is then used to form arg(X(e’™)|04), 2, > 4, and so on. 


For this algorithm to be practical, one must take full advantage of the FFT algorithm and reduce the 
number of extra discrete Fourier transform (DFT) computations to a reasonably small number. Let us 
denote by 


{o,=(20/N)k, k=0,1,....N—1} (6) 


the set of uniformly spaced frequencies with interval 27/N where N = 2™ (or, in general, any highly 
composite number). The phase derivative and the principal value of the phase at these frequencies 
may then be computed using FFT’s to evaluate the DFT’s of x(n) and nx(n), At each w,, a phase 
estimate is initially formed by one-step trapezoidal integration, starting at w,—). If the resultant esti- 
mate is not consistent, the adaptive integration scheme is applied within the interval [w,-),@,]. The 
step size adaptation was carefully designed to minimize the number of extra DFT’s required. The 
search for consistency is done by consecutively splitting the step interval in half. As the required phase 
derivatives and principal values are computed, they are stored in a stack fashion. As soon as a con- 
sistent estimate is found, the corresponding data are moved out of the stack to a register that holds the 
most recent consistent estimate of the phase at some frequency within [w,—),«,]. New estimates are 
always formed by integrating from the most recent estimate to the frequency corresponding to the top 
of the stack. 


3. Program Description 


The desired sequence x(n) is generated within the main program CCMAIN through subroutine 
COEFF. A diagram of this mainline program is given in Fig. 1. The FFT length and threshold levels 
THLCON (of Eq. (5)) and THLINC (see Section 5 on computational accuracy for a description of this 
threshold) are initialized. The computation of the complex cepstrum is accomplished by calling subrou- 
tine CCEPS and proceeds as follows. First, the FFTs of both x{n] and nx[n] are computed. Then, the 
log spectral magnitude, the principal value of the phase, and the phase derivative of x[n] on the FFT 
frequency grid are evaluated. Next, adaptive phase unwrapping is successfully performed between these 
equispaced frequencies, through the use of function PHAUNW. A block diagram of this program is 
given in Fig. 2. After the successful completion of the unwrapping, the linear phase component is 
removed and an IFFT taken, to yield the complex cepstrum £[n]. A block diagram of CCEPS is given 
in Fig. 3. Within CCMAIN the first and last 32 values of the complex cepstrum are then printed, along 
with its corresponding sign and linear phase component. 


The code for these routines and additional secondary routines is given in the Appendix where 
dimension requirements are specified. 
4. Test Problem 


In order to facilitate testing, as well as help the user getting acquainted with the potentialities and 
limitations of this program, the subroutine COEFF is provided for generation of test signals of finite 
length, with prescribed z-transforms. 


Section 7.1 CEP 
MAIN PROGRAM: CCMAIN 


Specify input 
x[n],n=0,1...NX-1 


Specify: 
© FFT length, NFFT 

* Phase consistency threshold, THLCON 
* Phase increment threshold, THLINC 


Comput 
complex cepstr 
CCEPS 


Was 
CCEPS 
successful: 
ISSUC=.TRUE, 7? 


NO YES 


Output 
complex 
cepstrum 


Fig. 1 Block diagram of main program: CCMAIN. 


The specifications included in CCMAIN will generate a sequence x[n] whose z-transform X(z) has 
6 zeros at z),z¥ ,z2,23 ,z3,2, where: 
2; = (0.9) e*/# 


We+s >) 
m=(1ie 4 ae 
=, 20 

UGE + G52?! 


z3= .9)e 


The output of CCMAIN is given in Table 1. The results match those evaluated analytically, using 
the equation 


* * 
zi +2)" +29 +23" 
|_| 21 1 3 cal eee 
S[n] = (7) 


n<0 
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FUNCTION PHAUNW 


Stock initiatizotion 


Update previous 
estimote 


Compute phose Evotuote phose 


derivative ond increment 
principle volue of across 
phose ai ediote spectro! 
frequency interval 


Is 
increment 
greoter thon 

THLINC? 


NO 


[Sains | 
estimote 


phose estimote: 
ISCONS= 
.TRUE.? 


ISCONS=.FALSE, 


RETURN 


Fig. 2 Block diagram of Tribolet’s adaptive phase unwrapping algorithm. 
5. Computational Accuracy 


It is important to realize that when the input data x(m) has a number of very sharp zeros near the 
unit circle (although not on it), the computational noise generated, for example, in the FFTs, may lead 
to erroneous values for the principal value of the phase and for the phase derivative near such zeros. 


Subroutine PHAUNW is designed to detect such cases and interrupt the unwrapping process, typing 
the message "Phase Estimation Failed". This detection is controlled by the values THLINC and 
THLCON. 


THLCON is defined by Eq. (5) of Section 2. and, for most seismic and speech signals of our 
interest, is set at 0.5. THLINC is used to detect the possibility of an erroneous 2ml.(Q,) of Eq. (3) in 
a region of a sharp zero; that is, a poor integration step within Eq. (4) may lead to a consistent estimate 
but in error by a 27 multiple. Setting THLINC to 1.5 will avoid any such phenomenon, by requiring 
further step adaption, when the unwrapped phase increment is greater than 1.5. However, in certain 
circumstances the stack memory may not be sufficient for the given thresholds. 


For example, if the magnitudes of z},z) and z; in the example above are 0.9999, 1.0001 and 0.9999, 
respectively, then the unwrapping fails. 


The authors tested a version of this program on an ECLIPSE minicomputer, using precisely the 
code published in this book, except in that its compilation (including the FFTs) was done using the 
Eclipse-Fortran 5 Double Precision Compiler Option. This has the effect of forcing all real variables 
and constants to become double precision. Furthermore, all single precision Fortran library functions 
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SUBROUTINE CCEPS 


Compute FFTs of 
x[n) and nx{(n} 


Compute ot each FFT frequency: 
‘*Log- magnitude 

*Unwropped phose: 
FUNCTION PHAUNW 


consistent: 
ISCONS* 
sTRUE.? 


Remove lineor phose component 


Compute complex cepstrum, x(n}: 
IFFT 


Fig. 3 Block diagram of program for computation of complex cepstrum. 
having double precision counterparts are replaced by them. 


Such double precision version of this code was capable of correctly unwrapping the data of the 
example above. An important issue in the usage of this program is therefore the selection of threshold 
levels THLINC and THLCON. 


Small values of these thresholds are associated with high probability of error detection, and thus 
with greater confidence in the program’s output. Unfortunately, the use of small threshold values is 
also associated with longer computation times. 


The user is thus strongly encouraged to run this program under a variety of test signals, so as to 
determine the accuracy requirements and maximum threshold levels that might be appropriate for his 
particular application. 
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Table 1 Output of main program: CCMAIN. 


INPUT SIGNAL-LENGTH (IN SAMPLES) = He 


x( 1)= 1.0000 x( 2)= -4.0996 Xx( 3)= 8.4057 x( 4)=-10.1765 
x( 5)= 7.7801 x( 6)= -3.5142 x( 7)= 0.7939 X( 8)= 0, 


SIGN= 1 
LINEAR PHASE= -2 


COMPLEX CEPSTRUM 


CX( 993)= -0.0030 Cx( 994)= -0.0024 Cx( 995)= -0.0000 Cx( 996)= 0,0030 
CX( 997)= 0.0050 CX( 998)= 0.0040 CX( 999)= 0,0001 Cx(1000)= -0.0052 
€X(1001)= -0.0085 CX(1002)= -0.0069 CX(1003)= -0.0001 CxX(1004)= 0.0090 
cx(1005 0.0149 CX(1006)= 0.0123 CxX(1007)= 0.0001 Cx(1008)= -0.0164 
€X(1009)= -0.0272 CX(1010)= -0.0227 CX(1011)= -0.0002 Cx(1012)= 0.0314 
€X(1013)= 0.0531 CX(1014)= 0.0453 CX(1015)= 0.0003 CX(1016)= -0,0664 
CX(1017)= -0.1166 CX(1018)= -0.1040 CX(1019)= -0.0004 CX(1020)= 0.1753 
€X(1021)= 0.3415 CX(1022)= 0.3546 CX(1023)= 0.0006 CX(1024)= -1.2852 


cx( 1)= 0.1906 Cx( 2)= -2.5446 Cx( 3)= 0.0012 Cx( 4)= 0.6881 
cx( 5)= 0.6561 Cx( 6)= 0.3334 Cx( 7)= -0.0008 cx( 8)= -0.1938 
cx( 9)= -0.2152 CX( 10)= -0.1213 CX( 11)= 0.0005 CX( 12)= 0.0810 
CX( 13)= 0.0941 CX( 14)= 0.0550 CX( 15)= -0.0004 CX( 16)= -0.0390 
CX( 17)= -0.0463 CX( 18)= -0.0276 CX( 19)= 0.0002 CX( 20)= 0.0203 
CX( 21)= 0.0243 CX( 22)= 0.0146 CX( 23)= -0.0002 Cx( 24)= -0.0110 
Cx( 25)= -0.0133 CX( 26)= -0.0080 CX( 27)= 0.0001 CX( 28)= . 0062 
CX( 29)= 0.0075 Cx( 30)= 0.0045 CX( 31)= -0.0001 CxX( 32)= -0,.0035 
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Computation of the Real Cepstrum and 
Minimum-Phase Reconstruction 


T. F. Quatieri 


Massachusetts Institute of Technology 
Cambridge, MA 02139 


and 


J. M. Tribolet 


Instituto Superior Tecnico 
Lisbon, Portugal 


1. Purpose 

The program is designed to compute the real cepstrum and the minimum-phase reconstruction of an 
arbitrary phase, real sequence x(n). The real cepstrum is defined as the inverse Fourier transform of 
the log magnitude of the Fourier transform of the input sequence. 


2. Method 


The real cepstrum x(n) of a real sequence £(n) is evaluated by means of the DFT computational 
realization as discussed by Oppenheim and Schafer [1]. 


&(n) = IDFT (log/|DFT(x(n)|) (1) 
where the DFT length is sufficient to avoid cepstral aliasing. 
For the minimum-phase reconstruction of a sequence x[m], the real cepstrum £[n] is windowed by 
win): 
Oo n<0 
win] =j1 2 =0 (2) 
2 n>0 
With x(n) having a rational ztransform, this windowing operation is equivalent to mapping 
maximum-phase poles and zeros to their conjugate symmetric counterparts within the unit circle of the 
zplane. Finally, the minimum-phase reconstructed sequence y[n] is computed by inverse complex 
cepstral mapping f{n] = %[{n]w[n]. This mapping is evaluated as follows: 


yn] = IDFT(exp[DFTQIn])}) (3) 
The inverse DFT length must likewise be sufficient to avoid aliasing in the time domain. 


The inverse mapping may also be used after windowing the real cepstrum or complex cepstrum to 
accomplish separation of two convolutionally combined sequences whose cepstra are additively com- 
bined. For example, a "low-time" rectangular cepstral window is often applied in speech processing to 
retrieve the cepstrum of the vocal tract impulse response, and a "high-time" window is used in seismic 
processing to recover the earth’s reflector series (Oppenheim and Schafer [1]). 


3. Program Description 


The three steps involved in the computation of the forward mapping are respectively, an FFT, 
determination of the log magnitude spectrum, and an IFFT. This task is performed by subroutine 
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SUBROUTINE: RCEPS SUBROUTINE: ICCEPS 


Transform cepstrol 


Transform input 
sequence, cx(n): 
FFT 


sequence, x(n): 
FFT 


Exponentiate 
the log- 
spectrum 


Inverse 
Transform: 


si 
Transform: 
IFFT 


Fig. 1 Block diagram of subroutine RCEPS. Fig. 2 Block diagram of subroutine ICCEPS. 
RCEPS, whose flow diagram is depicted in Fig. 1. 

The three steps involved in the inverse mapping are respectively, an FFT, complex exponentiation, 
and an IFFT. This task is performed by subroutine ICCEPS, whose flow diagram is depicted in Fig. 2. 


The main program RCPICP first computes the real cepstrum of a specified sequence and FFT length 
by calling RCEPS. The first and last 32 values of this sequence are printed. Next, the minimum-phase 
reconstruction is determined, after appropriate windowing, by ICCEPS, and the first and last 32 values 
are again printed. 


The FFT lengths of the forward and inverse computations within RCPICP are equal, but in general 
these lengths can be tailored to the particular aliasing problems. A flow diagram of RCPICP is given in 
Fig. 3. 


The code for these routines and additional secondary routines are given in the Appendix along with 
array dimension requirements. 


4, Test Problem 
The input x[n] is a sequence whose z-transform X(z) contains one zero outside the unit circle: 
X(z) = (1.4+(1./0.99)z7) (4) 


The output of RCPICP is given in Table 1. These results are consistent with the analytical evaluation 
for both the real cepstrum and the minimum-phase reconstruction 


&(0] = log(1./0.99) 
X[n] = —(—0.495)"_ |n| > 0 (5) 
1.0101 n=0 
Xmintn] = 41.0000 n=1 
0.0000 elsewhere 
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MAIN PROGRAM: RCPICP 


Specify forword, 
inverse FFT 
lengths 
NFFTF ond NFFTL 


Cepstrol filtering: 
Find cepstrum 
of 


minimum-phose 
reconstruction 


Compute i 
tr 
ICCEPS 


Fig. 3 Block diagram of main program RCPICP. 
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Table 1 


*** RCPCIP- TEST PROGRAM OUTPUT «++ 


REAL CESTRUM 


CX( 993)= -0.011 


Cx( 997 -0.013 
cx(1001 -0.016 
cx(1005 -0.020 
cx(1009 -0.027 
CX(1013)= -0.037 
Cx(1017 -0.058 
CxX(1021)= -0.120 
cx( 

cx ( 

cx( 

Cx( 13)= -0.037 
Cx( 17)= -0.027 
cx( -0.020 
cx( -0.016 
cx ( -0.013 


CX( 994)= 


Cx(1006)= 


cx(1010 
cx(1014 


x(1018)= 
xX(1022)= 


cx( 
cx( 
cx( 
cx( 
cx( 
cx( 
cx( 
ex( 


2)= 

6)= 
10)= 
14)= 
18)= 
22)= 
26)= 
30)= 


MINIMUM-PHASE RECONSTRUCTION 


Tcx( 993)= 0.000 
Icx( 997 0.000 
Tex(1001 -0.000 


Icx(1005)= -0.000 
Icx(1009)= 0.000 
ICX(1013)= 0.000 
1CX(1017)= 0.000 
Tcx(1021)= -0.000 


cx ( 
Icx( 
Icx( 
ICx( 
Icx( 
Icx( 
ICX( 
Tex ( 


1)= 1.010 
5)= 0.000 
9)= -0.000 
13)= -0.000 
17)= -0.000 
0.000 


29)= -0.000 


Icx( 994)= 
Icx( 998)= 
ICx(1002)= 
Icx(1006)= 
ICxX(1010)= 
1Cx(1014)= 
1Cx(1018)= 
IcxX(1022)= 


Icx( 
Icx( 
Icx( 
ICx( 
ICX( 
Icx( 
Icx( 
Icx( 


2)= 

6)= 
10)= 
14)= 
18)= 
22)= 
26)= 
30)= 


0.012 
0.014 
0.017 
0.022 
0.029 
0.041 
0.067 
0.162 


0.495 
0.095 
0.051 
0.034 
0.025 
0.019 
0.016 
0.013 


-0.000 
-0.000 
-0.000 
0.000 
0.000 
-0.000 
-0.000 
0.000 


1.000 
0.000 
000 
-0.000 
0.000 
0.000 
0.000 
0.000 
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cx( 995)= -0.012 


cx( 999 -0.015 
cx(1003 

Cx(1007)= -0.023 
x(1011)= -0.031 


Cx(1015)= -0.045 
cx(1019)= -0.078 
CX(1023)= -0.245 


ex( 
cx( 
cx( 
cx( 
cx( 
cx( 
cx( 
cx( 


3)= -0.245 
7)= -0.078 
11)= -0.045 
15)= -0.031 
19)= -0.023 
23)= -0.018 
27)= -0.015 
31)= -0.012 


Icx( 995)= 0.000 
Icx( 999)= -0.000 
Icx(1003)= -0.000 
Icx(1007)= -0.000 
Icx(1011)= -0.000 
Icx(1015)= -0.000 
ICx(1019)= -0.000 
Iex(1023)= 0.000 


Icx( 
Icx( 
Tex( 
Icx( 
Icx( 
ICx( 
Icx( 
TCx( 


3)= 0.000 
7)= 0.000 
11)= -0.000 
15)= -0.000 
19)= -0.000 
23)= -0.000 
27)= -0.000 
31)= -0.000 


Cx( 996)= 
cx(1000)= 
cx(1004)= 
cx(1008)= 
cx(1012)= 
cx(1016)= 
©x(1020)= 
CX(1024)= 


cx( 
cx( 
cx( 
cx( 
cx( 
cx( 
cx( 
cx( 


4)= 

B)= 
12)= 
16)= 
20)= 
24)= 
28)= 
32)= 


ICX( 996)= 
IcX(1000)= 
Icx(1004)= 
IcX(1008)= 
1CX(1012)= 
1Cx(1016)= 
1Cx(1020)= 
1cx(1024)= 


Icx( 
Icx( 
ICx( 
rcx( 
rcx( 
Icx( 
Icx( 
Icx( 


4)= 

8)= 
12)= 
16)= 
20)= 
24)= 
28)= 
32)= 
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0.013 
0.016 
0.019 
0.025 
0.034 
0.051 
0.095 
0.495 


0.162 
0.067 
0.041 
0.029 
0.022 
0.017 
0.014 
0.012 


0.000 
-0.000 
0.000 

0.000 

0.000 

0.000 

0.000 
-0.000 


0.000 
-0.000 
-0.000 

0.000 

0.000 

0.000 

0.000 

0.000 
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CHAPTER 8 


Interpolation and Decimation 


R. E. Crochiere 


Introduction 


The processes of interpolation and decimation are fundamental operations in.digital signal process- 
ing. They are used whenever it is necessary to change from one sampling rate to another in a digital 
system. For example, in speech processing, estimates of speech parameters are often computed at a 
low sampling rate for low bit-rate storage or transmission. This operation can often be conveniently 
defined in terms of concepts of decimation. For reconstructing a synthetic speech signal or a decoded 
replica of the original speech from the low bit-rate representation, the speech parameters are normally 
required at much higher sampling rates. In such cases, the sampling rate must be increased by a digital 
interpolation process. 


The techniques of interpolation and decimation are also useful in defining highly efficient ways for 
implementing narrow band FIR filters and modulators. By careful design these techniques can be used 
for bandpass and highpass filters as well as the traditional lowpass filter. Computational efficiencies 
comparable to those of recursive elliptic filters are possible while still retaining the desirable properties 
of linear phase response and limit-cycle free operation. Yet another application of decimation and 
interpolation concepts can be found in digital phase shifting and in implementations of fractional sample 
delays. 


Two types of computational issues generally arise in the design and implementation of interpolation 
and decimation systems. The first issue involves the design of appropriate filters around which the 
decimation or interpolation is based. The second issue involves the actual implementation of the deci- 
mation or interpolation processing. Three programs are provided in this section, in addition to the pro- 
grams in other sections, which are useful in accomplishing these tasks. 


The design of interpolation or decimation filters involves the use of lowpass (or bandpass) digital 
filters. Such filters can be designed in a variety of ways, e.g. window designs, equiripple designs, etc. 
For many applications this design can be achieved by the use of the filter design programs in Chapter 5. 
However, for interpolation designs with mean square minimization of interpolation error and preserva- 
tion of original signal values, specialized procedures exist. 


Program 8.1 is one such example in which this mean square error criterion is used. The program 
applies to the design of interpolation filters in which the sampling rate is increased by an integer factor 
of R. The resulting filter design allows the original input samples to pass through the interpolator 
unchanged and it interpolates R—1 sample values between each pair of original samples in such a way 
that the mean square error between these samples and their theoretically ideal values is minimized. 
The design is achieved through the formulation of an L XL matrix inversion where 2L is the number of 
original sample values used to interpolate each new sample. The resulting interpolation filter is a 
2RL + 1 tap, linear phase, FIR, digital filter. The size of L is limited to be 10 or less and the program 
requires the use of a matrix inversion program which is provided. 


The implementation of interpolators or decimators involves the implementation of digital filters in 
which the input and output sampling rates are different. Because of this difference in sampling rates a 
straight-forward implementation of FIR digital filter structures is not practical. Instead, special 
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considerations must be taken in interfacing the different sampling rates and in efficiently implementing 
the digital filter. The next two programs in this section provide alternative approaches to this problem 
based on whether the ratio between the two sampling rates is of the order of unity (say for example 5/8 
or 16/15) and can be expressed as a ratio of integers, or whether the ratio is a very large integer value 
which can be factored into smaller integer values (for a cascade implementation). 


Program 8.2 covers the first category in which the ratio of output to input sampling rates can be 
expressed as L/M where L and M are arbitrary integers. In the case where M = | an integer interpola- 
tion by a factor of L is performed and when L = | an integer decimation by a factor of M is performed. 
The program requires a coefficient array of a symmetric FIR decimating or interpolating filter which 
must be supplied by the user (any of the above designs can be used). After an initialization call, data 
can be processed in a consecutive block-by-block manner by repeated calls to the program. Data is 
received and returned in blocks whose sizes are related by the ratio L/M to accomodate the difference 
in input and output sampling rates. 


Program 8.3 covers the second category of decimation and interpolation implementations in which 
the ratio of output to input sampling rates is a large integer (in the range 15 and up) which can be fac- 
tored into smaller integer values. Generally it is more efficient in this case to perform the interpolation 
(or decimation) by a series of cascaded stages of interpolators (or decimators). In this way the filter 
requirements and computation at each stage can often be substantially reduced over that of a single 
stage implementation. For example a 1:100 interpolator might be more efficiently implemented by a 
three stage cascade of interpolators with conversion rates of 1:2, 1:5, and 1:10 than by a single stage 
conversion. For such a case, speed improvements of up to 50 can be obtained. The filter designs for 
each of the stages must be supplied by the user. As in Program 8.2, after an initialization call, data is 
processed in a consecutive block by block manner with unequal input and output block sizes to accomo- 
date the different input and output sampling rates. The program can implement 1, 2 or 3 stage decima- 
tor or interpolator designs. It also has the capability of implementing a cascade of a (1, 2, or 3 stage) 
decimator and a (1, 2, or 3 stage) interpolator for the efficient implementation of narrowband FIR 
filters. 


In addition to the programs and methods presented here, a number of other techniques and design 
methods for decimation and interpolation have been proposed in the literature. Bellanger et al. (1,21, 
for example, have proposed design techniques based on single stage or cascaded stages of 2:1 decima- 
tors or interpolators with “half band" digital filters. In this case advantage can be taken of the fact that 
half of the coefficients in the digital filter are exactly zero. Goodman and Carey [3] have proposed a 
number of specialized, low order, filter designs for cascaded stages of decimators or interpolators. 
Parks and Kolba [4] have recently proposed a new minimax filter design for interpolation to comple- 
ment the least square designs of Program 8.1. 


References 


1. M. G. Bellanger, J. L. Daguet, and G. P. Lepagnol, "Interpolation, Extrapolation, and Reduction 
of Computation Speed in Digital Filters", /EEE Trans. Acoust., Speech, Signal Processing, Vol. 
ASSP-22, No. 4, pp. 231-235, Aug. 1974. 


2. M. G. Bellanger, "Computation Rate and Storage Estimation in Multirate Digital Filtering with 
Half-Band Filters", /EEE Trans. Acoust., Speech, Signal Processing, Vol. ASSP-25, No. 4, pp. 344- 
346, Aug. 1977. 


3. D. J. Goodman and M. J. Carey, "Nine Digital Filters for Decimation and Interpolation", /EEE 
Trans. Acoust., Speech, Signal Processing, Vol. ASSP-25, No. 2, pp. 121-126, April 1977. 


4. T. W. Parks and D. P. Kolba, "Interpolation Minimizing Maximum Normalized Error for Band- 
Limited Signals", /EEE Trans. Acoust., Speech, Signal Processing, Vol. ASSP-26, No. 4, pp. 381-384, 
Aug. 1978. 


8.0-2 


8.1 


A Computer Program for Digital Interpolator Design 


G. Oetken 


Institut fiir Nachrichtentechnik 
Universitat Erlangen-Niirnberg 
Cauerstrasse 7 
8520 Erlangen, Germany 


T. W. Parks 


Department of Electrical Eng. 
Rice University 
Houston, TX 77001 


H. W. Schiissler 


Institut fiir Nachrichtentechnik 
Universitat Erlangen-Niirnberg 
Cauerstrasse 7 
8520 Erlangen, Germany 


1. Purpose 
This program [1] designs a length 2rL + 1 FIR interpolating filter with unit pulse response A (1), 
n =—rL,...,rL, which, given every r-th sample of a signal x(m), interpolates the remaining samples. 
2. Method 
The unit pulse response /(n) is designed so that 
NGL J) % — xi? 


is minimized for bandlimited signals x(n). The symbol * represents convolution and - represents mul- 
tiplication. The symbol , Tepresents sampling, 


1 n=0 mod r 
LL] -(n) = { otherwise 
The signal x(n) is assumed to be bandlimited with 
X() =0 for |o| >a a/r. 
The squared norm of the error is 
Nell? = > e(n)?. 


The method divides 4 (m) into r subsequences A .(!) = h(rl+7), 7 = 0,1,...,7—1 and solves the follow- 
ing set of linear equations for each + 
L-1 
h(rl+7)6(r(I—m)) = 6(rmtz) m =-L,...,.L—-1 
L 


f= 


where 6(k) = i |X (@)|?e~/*"dw is the autocorrelation of x. In terms of matrices these equations 
-ha/r 


become 
Gh, =9,. 
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Rather than invert the 2Lx2L matrix ©, the algorithm, using symmetries of ®, inverts 2 LxL 
matrices. These inverse matrices are then used to calculate only the first half of the pulse response 
h(-rL),...,h(0) since h(n) is an even function. 

3. Program Description 
3.1 Usage 

The subroutine DODIF requires subroutine SMINVD and a user defined function DPH1. 

3.2 Subroutines and Functions 


SUBROUTINE DODIF (L,R,ALPHA,DIF) is called from a main program and designs the optimal digi- 
tal interpolating filter. 


SUBROUTINE SMINVD (A,N,EPS,IER) inverts positive definite symmetric matrix using double preci- 
sion. 


DOUBLE PRECISION FUNCTION DPH1 (X,ALPHA) calculates the autocorrelation of the input data. 
3.3 Description of Parameters 


R- Wanted increase in sampling rate, i.e., the filter calculates R—1 samples between each pair of 
input samples. Range for R is any integer >1. 
L- Integer, L, which determines the degree of the filter. The degree is 2-L-R. Range for L is 


1 to 10, may be increased at the risk of numerical instability (change LMAX and array 
bounds of AP,AM,D for L > 10). 


ALPHA — Cutoff frequency (radians) of the filter input data divided by 7/R. Range for ALPHA is 
0 < ALPHA < 1.00 (double precision). 


DIF — Double precision array in which the first half (L-R+1 values) of the unit sample response is 
returned. (The optimal filter has linear phase.) 


A- Double precision upper triangular part of given positive definite symmetric NxN matrix 
stored columnwise. On return A contains the upper triangular part of the resulting inverse 
matrix in double precision. 


N- The number of rows (columns) in the given matrix. 
EPS — Relative tolerance for test on loss of significance. 
IER — Resulting error parameter IER = —1 indicates error in inverting matrix possibly due to loss 


of significance. 
2, Point for which the autocorrelation is desired. 
3.4 User Requirements 


The user must supply the main program and the autocorrelation function DPH1. In the main pro- 
gram the dimension of DIF must be fixed at a value greater than or equal to L-R+1. 


Big values of L and small values of ALPHA increase the possibility of problems with matrix inver- 
sion (depending upon the wordlength of the computer). A very good possibility to control the quality 
of the matrix inversion is to check the magnitude of the unit sample response DIF(K) at 
K=M-R +1, M =0to L—1, which ideally have to be zero. 

4. Test Problem 
A test program was run to design an interpolating filter for data with a flat spectrum, i-e., 
|X@)|?=1 for |w| < az/r. 
The parameters were R = 4, L = 4, and ALPHA = 0.500. 
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Table 1 


OPTIMAL INTERPOLATING FILTER DATA 
L= 4 R= 4 ALPHA= 0.50 
THERE ARE 17 VALUES IN HALF OF THE FILTER 


H(-16)= 0. 

H(-15)= -0.4559319E-02 
H(-14)= -0.6777514E-02 
H(-13)= -0.5177760E-02 
H(-12)= -0.8881784E-15 
H(-11)= 0.2578440E-01 
H(-10)= 0.3945777E-01 
H( -9)= 0.3118661E-01 
H( -8)= -0.8881784E-15 
H( -7)= -0,8770110E-01 
H( -6)= -0.1426581E 00 
H( -5)= -0.1220465E 00 
H( -4)= -0.3552714E-14 
H( -3)= 0.2910058E 00 
H( -2)= 0.6098364E 00 
H( -1)= 0.8713054E 00 
H( O)= 0.1000000E 01 
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A General Program to Perform Sampling Rate 
Conversion of Data by Rational Ratios 


R. E. Crochiere 


Bell Laboratories 
Murray Hill, NJ 07974 


1. Purpose 


This program can be used to convert the sampling rate of data by factors of L/M where L and M are 
arbitrary positive integers. Input data is provided through an input buffer in blocks of length Np M and 
output data is received through an output buffer in blocks of NpZ where Np is any positive integer. 


2. Method 


The program is based on the one stage interpolator/decimator method of R. E. Crochiere and L. R. 
Rabiner [1,2]. Conceptually the method is depicted in Fig. 1. 


DECREASE y(n) 
SAMPLING 
RATE BY M 


Fig. 1. Sampling rate converter 


The input sampling rate /, is increased by a factor L by inserting L—1 zero valued samples between 
each pair of input samples. This signal is then filtered with an FIR lowpass filter whose stopband cutoff 
frequency is f,/2 or Lf,/(2M), whichever is smaller. The output signal of the filter is then reduced by 
a factor of M by keeping only one out of every M samples. By the elimination of multiplications by 
zero and elimination of computing unnecessary output samples it has been shown in [1] that the output 
y(n) can be computed by the relation 
nM 
[24|-4 0 


where ( )@®L implies the quantity in parentheses modulo L and [] corresponds to the integer less than 
or equal to the number in brackets. The sequence /(n), n =0,1,...,.N—1 represents the coefficients of 
the FIR filter and NV is the number of taps in the filter such that 


N<QL (2) 


= 
y(n) = 3) h(kL + (nM) ® L) x} 


k=O 


and Q is an arbitrary positive integer. 


Figure 2 shows the flow diagram of the program which implements relation (1). Input data x(n) is 
supplied through BUFM and output data y(m) is received through BUFL. QBUF stores the necessary 
internal state variables and COFS stores the coefficients f(n) in a prescribed "scrambled" order such 
that they can be sequentially accessed (see [1]). ICTR is a control memory which is generated by the 
initialization program and is used to control the indexing of data and coefficients in the program. 


The group delay of the sampling rate converter at the output sampling rate is 
[ox 


T= 


qt = wv] (samples) (3) 
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INPUT OUTPUT 
BUFFER BUFFER 


CE 


Q 


i 
ete 


’ h(n) (SCRAMBLED) 


ICTR 


INDEX CONTROL OF 
QBUF UPDATE AND 
COFS SELECTION 


Fig. 2. Flow diagram of program 


where it is assumed that the FIR filter is a linear phase, i.e., symmetric, filter. If a zero delay conver- 
sion is required, the filter length N can be selected to make 7, an integer and the first T, output sam- 
ples can be discarded. 


3. Program Description 
3.1 Usage 


The program consists of a main program (supplied by the user) and two subroutines, one for initializa- 
tion (SRINIT) and one for processing (SRCONV). On initialization the user supplies values for the 
parameters M, L, NQ, COEF, N, NC and NI. For processing the user supplies values for BUFM, 
BUFL, and ND. Once the program is initialized SRCONV can be used as often as necessary for pro- 
cessing contiguous blocks of data. 


3.2 Description of Parameters 


M Decimation ratio (see Fig. 1), M. 

L Interpolation ratio (see Fig. 1), L. 

QBUF Internal buffer for storage of state variables of filter. 

NQ see rei QBUF, equal to or greater than 2*Q, where Q is the next greatest integer 
of ‘ 


COEF Buffer containing FIR symmetric filter coefficients. Because of symmetry the 
buffer should contain only half of the filter coefficients beginning at the middle 
impulse response coefficient. 


N No. of taps in FIR filter, N. 

COFS Buffer for storing scrambled coefficients. 

NC Size of buffer COFS, equal to or greater than L*Q where Q is the next greatest 
integer of N/L. 

ICTR Buffer for storing control data generated by SRINIT and used by SRCONV. 

NI Size of ICTR, greater than or equal to 2*L. 


IERR Error code for debugging 
= 0 No errors found in initialization 
= 1 QBUF (NQ) too small 


8.2-2 


Section 8.2 SRCONV 
= 2 COFS (NC) too small 
= 3 ICTR (NI) too small 
BUFM Input data buffer for processing, size Np*M. 
BUFL Output data buffer for processing, size Np* L. 
ND Any positive integer, Np. 
3.3 Dimension Requirements 


The DIMENSION statement in the main program should be modified according to the requirements of 
each particular problem. The required minimum dimensions of the arrays are 


QBUF must be of dimension equal to or greater than 2* (the next greatest integer of 
N/L). 


COEF must be of dimension [(N+1)/2] where [x] is the integer part of x. 


COFS must be of dimension Q*L where Q is equal to or greater than the next largest 
integer of N/L. 


ICTR must be of dimension 2*L. 
BUFM must be of dimension Np*M. 
BUFL must be of dimension Np*L. 
3.4 Summary of User Requirements 
(1) Specify M, L, NQ, N, NC, NI 
(2) Fill in coefficient buffer COEF 
(3) Adjust dimensions for QBUF, COFS, ICTR, COEF, BUFM, BUFL 
(4) CALL SRINIT once for initialization 
(5) Supply BUFM with input data 
(6) CALL SRCONV and obtain output samples in BUFL 
(7) Repeat steps (5) and (6) as often as desired 


4. Test Problem 


Compute the unit sample response of a sampling rate converter which converts data from a sampling 
rate of 10 kHz to 16 kHz. 


The ratio of conversion is 16/10 or preferably 8/5. Therefore, L = 8 and M =5. The input sampling 
rate f,, is 10 kHz and the output sampling rate L/,/M is 16 kHz. As seen from Fig. 1 the intermediate 
sampling rate Lf, is 80 kHz which corresponds to the effective sampling rate of the lowpass filter. 
Since 10 kHz is the lowest sampling rate involved, the lowpass filter should have a stopband cutoff of 
one half of this rate or 5 KHz. The filter was designed using the McClellan, et al. program [3]. 


The test program reads in the filter coefficients from the standard input unit and outputs them to the 
standard output unit. It initializes the conversion routine by calling SRINIT and then generates a unit 
sample in the BUFM array by zeroing it out and setting the first sample value to one. It converts the 
sampling rate of this array by the factor 8/5 by calling SRCONV. BUFL then contains the interpolated 
impulse response of the sampling rate converter at the 16 kHz sampling rate. Figure 3a shows a plot of 
this response. 
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yin) lA X 
AMPLITUDE. 
° 5 10 15 20 
TIME (SAMPLES) 


(a) IMPULSE RESPONSE 


° 
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@ 
(ot -40 
-60 
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Fig. 3. Impulse response, frequency response, and group delay of test example. 


Figure 3b shows the log magnitude of the frequency response obtained by taking the Fourier transform 
of Fig. 3a, The filter characteristics are clearly evident. Figure 3c shows the group delay of the sam- 
pling rate converter. Note that the delay is 11 samples as predicted by Eq. (3) and is exactly flat with 
frequency because of the linear phase (symmetric) FIR filter. 


Table 1 shows the output of the test program for the case L = 8, M =5, and N = 119; the coefficients 
of the 119 tap FIR filter input to test program are echoed back in the output of the test example. Also 
the unit sample response of Fig. 3a is given in Table 1. 
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COEFFICIENTS 
+ 098344 - 096741 
+ 062882 .050073 
«001611 006898 
-.018966 017123 
~.001477 +002359 
-009248 «008652 
-001279 000722 
-.004700 .004502 
-.000896 000157 
«002545 002576 
~001277 000844 
~-000268 -.000345 
IERR= 0 
UNIT SAMPLE RESPONSE 
~.002144 .010217 
+ 010230 . 073986 
+ 503055 «786755 
-.011818 073986 
«020362 ~010217 


Table 1 


+092027 
- 036869 
~.013228 
~.014002 
.005488 
-007342 
~-002410 
-.003916 
»001076 
-002416 
000452 
-.000357 


+020362 
-.011818 
+503055 
+010230 
-.002144 
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-084489 
023975 
-.017283 
--010055 
+ 007720 
005525 
~.003668 
-.003043 
.001799 
002112 
000129 
-.000319 


-.007169 
-.151726 
012884 
-.037602 
000000 


~074579 
012040 
-.019127 
--005738 
008970 
.003429 
~.004435 
-.001998 
+002292 
+001715 
-.000112 
-.000533 


-.037602 

-012884 
--151726 
--007169 


SRCONV 
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A Program for Multistage Decimation, 
Interpolation, and Narrow Band Filtering 


R. E. Crochiere and L. R. Rabiner 


Acoustics Research Dept. 
Bell Laboratories 
Murray Hill, NJ 07974 


1. Purpose 


This program decimates, interpolates, or narrow band filters an input signal using a multistage reali- 
zation with up to 3 stages for both decimation and interpolation. The output sequence is written 
directly over the input sequence. 


2. Method 


The program is based on the method of R. E. Crochiere and L. R. Rabiner [1,2,3]. The user can 
decimate and interpolate (by an integer ratio) or narrow band filter (by a combination of integer deci- 
mation and interpolation) a signal by performing these operations in a series of stages. Up to three 
stages can be used for decimation and interpolation. For each stage a decimation ratio is required as 
well as a set of filter coefficients (of a direct form linear phase FIR digital filter) for the filtering to be 
performed in that stage. A block of samples of the input sequence is supplied and a block of samples 
of the output sequence is generated by the program. Thus to process a large sequence of samples the 
input sequence is partitioned into blocks and the program is called once for each block of samples. 


A flow diagram for the implementation of a three stage decimator in cascade with a three stage 
interpolator is shown in Fig. 1(a) and its corresponding control sequence is given in Fig. 1(b). 
Together the cascade results in the implementation of a narrow band lowpass filter. To realize only a 
decimator or interpolator, appropriate parts of this structure are partitioned off (in the program) from 
the main structure. 


The decimator has three data buffers S1D, S2D, and S3D for storage of internal data for its three 
stages. These storage buffers are of durations N’,, N’;, and N’; words respectively, These lengths are 
derived according to the relationship 


N'.=QD,2N,, i=1,2,3, (1) 


where Q, is the integer greater than or equal to N/D,, N, is the filter length for the th stage and D, is 
its decimation ratio. Each data buffer is partitioned into Q, blocks of data of length D,. Three addi- 
tional buffers hold the coefficients for the filters in each of the three stages. The interpolator has six 
data buffers associated with it, three (S1I, S21, and S3I) of lengths Q;, Q», and Q, respectively and 
three (T1I, T2I, and T31) of lengths D;, D2, and Dj respectively. In addition, each stage i has a buffer 
for the "scrambled" coefficients which are partitioned into D, blocks of Q, samples each. The operation 
of this structure is depicted by the control sequence in Fig. 1(b). The process begins by reading D, 
samples from the main I/O buffer into S1D. One output sample is then computed from stage one of 
the decimator and stored in S2D. This process is repeated D, times until D, samples have been com- 
puted and stored in S2D. One output is then computed for stage 2 of the decimator and stored in $3D. 
The above process is repeated D; times until D; samples have been stored in $3D at which point one 
output sample is calculated from stage 3 of the decimator. This completes one cycle of the decimator; 
D = D,\D,D; samples have been read from the main I/O buffer and one output sample has been com- 
puted. A similar computation cycle can now proceed for the interpolator. The output sample from the 
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MAIN I/O DATA BUFFER 


D a 
SAMPLES 


Nj'=0)0) = Nj 
i#1,2,3 


hy(n) (SCRAMBLED) 
COEF. VECTOR 


he(n) (SCRAMBLED) 
COEF. VECTOR 


j—— 22 | ae 22 | ae — 02 —e| 
SAMPLES | SAMPLES | SAMPLES 


STAGE 20 —— yz SAMPLES ——=— 


——Nz SAMPLES —= 


hy (n) (SCRAMBLED) 
COEF. VECTOR 


j—— 93 — 95 
SAMPLES SAMPLES 


—— Ns SAMPLES —= 


STAGE 30 


DECIMATION INTERPOLATION 
Fig. 1(a) Flowchart for a 3 stage decimator followed by a 3 stage interpolator. 


decimator is stored into S31. D; output samples are computed from stage 3 of the interpolator and 
temporarily stored in T3I. One sample from T3I is then stored in S2I and D, output samples are com- 
puted from stage 2 and stored in T2I. SII is then updated by one sample from T2I and D, outputs are 
computed and stored in the main I/O buffer. This is repeated until all D, samples in T2I are removed. 
T2I is then refilled by updating S2I with one sample from T3I and computing D, more samples. Upon 
completion of the interpolator cycle one input was transferred into the interpolator and D output sam- 
ples are computed and stored in the main I/O data buffer. The process can then be repeated on the 
next block of D samples. 


Because of the delay associated with the linear phase filters the output (decimated, interpolated, or 
filtered) waveform will have a delay associated with it with respect to the input. This delay can be 
determined as follows: let 


(samples) 
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START 


UPDATE SID 
BY Dy SAMPLES 
FROM MAIN I/O BUFF 


COMPUTE 1 OUTPUT 
SAMPLE FROM STAGE 1D 
& STORE IN S2D 


COMPUTE 1 OUTPUT 
SAMPLE FROM STAGE 2D 
& STORE IN S30 


COMPUTE 4 OUTPUT. 
SAMPLE FROM STAGE 30 


@ STORE IN S3I 
REPEAT 


MAIN I/ F 
1S_ FILTERED 


COMPUTE D3 SAMPLES 


IN STAGE 31 
TORE IN T3I 


UPOATE S2T 
BY 1 SAMPLE 
FROM T3I 


COMPUTE D2 SAMPLES 
IN STAGE 2T 
@& STORE IN T2E 


UPDATE SII 
BY 1 SAMPLE 
FROM T2I 


COMPUTE D, SAMPLES 


IN STAGE {I @ STORE 
IN MAIN 1/0 BUFF 


DONE 


Fig. 1(b) The control sequence for Fig. | (a). 


N>+1 
—~— (samples) 
2 
and 
N3+ 
Tu3= = (samples) 
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be the delays (group delay) of the filters for stages 1, 2, and 3. If only two Stages are used let Ty;=0 
and if only one stage is used let tT y»= Ty;=0. The group delay, 7 , of the multistage decimator at 


the output (the low sampling rate) is then 


1 
T= DDD, (ty) + Dity2+ D\Dot y3— (D\DD3-1)} (samples) 


(For decimator output) 
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where D;= 1 for a two stage implementation and D,= D;= 1 for a one stage implementation. The 
group delay for the interpolator output (at the high sampling rate) is 


TH=Tyi t+ Dity2+D,\Dyry3 (samples) 
(For interpolator output) 
and for the filter (at the high sampling rate) 
TH = UT yitDit yt DD y3) — (D\DD3s-1) (samples) 
(For the filter output) 
For the decimator and interpolator the group delay at the high sampling rate 7, is related to the group 


delay at the low sampling rate, 7,, by the expression 7,,= D\D,D37,. The duration of the overall 
impulse response is approximately twice the group delay. 


3. Program Description 
3.1 Usage 


The program consists of a main program (supplied by the user) and two subroutines, one for initiali- 
zation (DIINIT), and one for performing the required computation(DIFILT). The user is required to 
specify the number of stages, the decimation (interpolation) ratio for each stage, and a set of filter 
coefficients (of a direct form FIR linear phase filter) for each stage. In addition, the user supplies an 
input-output buffer to hold both the input and output sequences, and a scratch buffer of sufficient size 
to store all the internal buffers required in the computation. An error return is used to indicate any 
difficulty in initializing the package. Otherwise no output (other than the output array) is provided. 

3.2 Subroutines Required 

SUBROUTINE DIINIT (KD, ID1D, ID2D, ID3D, NID, N2D, N3D, COEF1, COEF2, COEF3, 
ITYPED, BUFF, IDJD, SBUFF, ISBD, IERR), called from main program, initializes the decimation- 
interpolation package. SUBROUTINE DIFILT (COEFI, COEF2, COEF3, BUFF, SBUFF) is called 
from the main program, once for each buffer of input samples, performs the required computation 
(i.e., decimation, interpolation, or narrow band filtering) and returns the output sequence in SBUFF. 
Assume BUFF is of size LD where L is an integer and D = D\D,D,. For a D:1 decimator fill BUFF 
with LD input samples and receive as output the first L samples in BUFF. For an interpolator supply 
only L samples to the first L locations in BUFF and receive as output LD samples. For a filter supply 
LD samples for input and receive LD samples as output. 


3.3 Description of Parameters 
KD Number of stages of decimation (and/or interpolation) 
IDID Decimation ratio for stage 1 (i.e., D\) 
ID2D Decimation ratio for stage 2 (i.e., D2) 


ID3D Decimation ratio for stage 3 (i.e., D3) 
(ID3D = 1 if KD = 2 and ID2D = ID3D = 1 if KD = 1) 


NID Filter duration (in samples) of linear phase FIR digital filter for stage 1 
N2D Filter duration (in samples) of linear phase FIR digital filter for stage 2 
N3D Filter duration (in samples) of linear phase FIR digital filter for stage 3 


(N3D = 0 if KD = 2and N2D = N3D = Oif KD = 1) 


COEF1 Buffer containing filter coefficients for stage 1 
COEF2 Buffer containing filter coefficients for stage 2 


COEF3 Buffer containing filter coefficients for stage 3. 
If the filter duration is odd, the program automatically changes COEFn(1) to COEFn(1)/2 
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for n = 1,2,3. Also COEFn contains half of the filter imapuilse response beginning at the 
middle impulse response coefficient. 


ITYPED =1 fora decimator alone 


= 2 foran interpolator alone 
= 3 for a narrow band filter (decimator followed by interpolator) 


BUFF Storage buffer for input and output sequence (Required dimension given below) 


IDJD 


Dimension of BUFF. (See below.) 


SBUFF Storage buffer for internal variables, and scrambled coefficients for interpolation 


ISBD 
IERR 
IERR 


stages). (Required dimension given below.) 
Dimension of SBUFF (see below). 
Error Return for initialization (useful for debugging purposes). 


=0 Noerrors 

=1 Means KD is out of range, i.e., KD > 3 or KD < 1 

= 2 Means dimension for BUFF is too small or not an integer multiple of 
(D \*D»*D)) 

= 3 Means dimension for SBUFF is too small. 


3.4 Dimension Requirements 
The DIMENSION statement in the main program should be modified according to the requirements 


of each part 


ticular problem. The required dimensions of the arrays are 


COEF! must be of dimension [(N1ID+1)/2] where [x] is the integer part of x 
COEF2 must be of dimension [(N2D+1)/2] 

COEF3 must be of dimension [(N3D+1)/2] 

BUFF must be of dimension IDJD which is computed by the rule 


IDJD = L*(ID1D*#ID2D*ID3D) 
where L is any nonzero integer, i.e., IDJD is an integer multiple of the total decima- 
tion (interpolation) ratio of the system. 


SBUFF must be of dimension ISBD which is computed by the rule: 


(a) For decimator only (ITYPED = 1) 
ISBD > 2*(NIP+N2P+N3P) 


where 
NIP = ase) + 1)*#IDID 
Nop = (X22) + 1)s1D2D 
N3P = ay + 1)*ID3D 


and [x] corresponds to the integer part of x (i.e., NIP, N2P, N3P correspond to 
N',, i =1,2,3 in Eq. (1)). 


(b) For interpolator only (ITYPED = 2) 


IDID ID2D *1D3D 


where N1P, N2P, and N3P are defined above in (a). 


ISBD > (NIP+N2P+N3P) + (ID2D+ID3D) + 2*(NIP_ 4 _N2P_,_N3P_) 
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(c) For narrow band filter (ITYPED = 3) 
ISBD >ISBD | +ISBD A 


for 
decimator interpolator 
(a) (6) 


3.5 Summary of User Requirements 
(1) Specify KD, IDID, ID2D, ID3D 


(2) Choose filter lengths NID, N2D, N3D and fill in filter coefficient buffers COEF1, COEF2, 
COEF3 


(3) Adjust dimension for BUFF and SBUFF 

(4) CALL DIINIT once for initialization 

(5) Supply BUFF with input data 

(6) CALL DIFILT and obtain output samples back in BUFF 

(7) Repeat steps (5) and (6) as often as necessary for continuous processing on blocks of IDJD sam- 
ples. 

4. Test Problems 

1. Decimate the allpass signal 


0 n<0 
x(n) = -a n=0 
(-a@)a"'=n21 


for a = 0.9, by a factor of 10 to 1 using a 2 stage decimator with decimation ratios of 5 to 1 (for stage 
1D - Fig. 1) and 2 to 1 (for stage 2D). The filter impulse response durations are 25 samples for stage 
1D, and 28 samples for stage 2D. 

The main program will print out the filter coefficients for each stage, and will print out both the 
input sequence, and the decimated output sequence. The reader should note that the input sequence is 
decimated using 3 calls to the decimation subroutine in which consecutive blocks of 20 samples are 
decimated to give consecutive blocks of 2 samples. 

The parameters for this example are: KD = 2, IDID = 5, ID2D = 2, ID3D = 1, NID = 25, 
N2D = 28, N3D = 0, ITYPED = 1, IDJD = 20, ISBD = 106. 

2.  Interpolate the allpass signal of example | using a 2 stage interpolator with interpolation ratios of 
1 to 2 (for stage 21+) and 1 to 5 (for stage 11). 

The filter impulse responses are the same as used in example 1. The main program will print out both 

the input sequence, and the interpolated output sequence. The reader should again note that the input 

sequence is interpolated using 3 calls to the interpolation subroutine in which consecutive blocks of 2 

samples are interpolated to give consecutive blocks of 20 samples. 

The parameters for this example are: KD = 2, IDID = 5, ID2D = 2, ID3D = 1, NID = 25, 
N2D = 28, N3D = 0, ITYPED = 2, IDJD = 20, ISBD = 106. 

3. Filter coefficients for a one stage decimator (or interpolator) with a decimation ratio of 10 to 1 are 
printed out to test out the one-stage implementation. 


Filter coefficients for a three stage decimator with decimation ratios of 10 to 1, 5 to 1 and 2 to 1 (for 
stages 1D, 2D and 3D respectively) are printed out to test the three-stage implementation. 


The output for these three examples including coefficient values, are contained in Table 1. 


+ The reader will recall that interpolation stages are numbered in reverse order because of their duality with decimation stages. 
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Table 1 


OUTPUT OF TEST PROGRAM 
COEFFICIENTS FOR STAGE 1 
«168728 «158866 «131836 094397 ~055181 ~021904 -.000775 
~.012024 -.014156 -.011033 -.006346 -.002682 -.000174 
COEFFICIENTS FOR STAGE 2 
352610 +202371 -022946 -.064816 -.045444 ~007674 027651 
~011124 -.007792 -.009267 -.001169 003120 +001807 -.000303 
INPUT SEQUENCE 
-.9000 .1900 .1710 .1539 .1385 .1247 .1122 .1010 .0909 .0818 
+0736 .0662 .0596 .0537 .0483 .0435 .0391 .0352 .0317 .0285 
DECIMATED OUTPUT SEQUENCE 
0000 -,.0003 
INPUT SEQUENCE 
+0257 .0231 .0208 .0187 .0168 .0152 .0136 .0123 .0110 .0099 
-0089 .0081 .0072 .0065 .0059 .0053 .0048 .0043 .0039 .0035 
DECIMATED OUTPUT SEQUENCE 
0011 ~.0017 
INPUT SEQUENCE 
-0031 .0028 .0025 .0023 .0020 .0018 .0017 .0015 .0013 .0012 
+0011 .0010 .0009 .0008 .0007 .0006 .0006 .0005 .0005 .0004 
DECIMATED OUTPUT SEQUENCE 


-.0004 .0079 
INPUT SEQUENCE 
-.9000 .1900 


INTERPOLATED OUTPUT SEQUENCE 
-.0000 -.0000 -.0000 -.0000 -.0000 -.0000 .0000 .0002 .0003 .0005 
+0006 .0005 .0003 -.0001 -.0008 -.0015 -.0024 -.0034 -.0043 -.0051 
INPUT SEQUENCE 
»1710 = «1539 
INTERPOLATED OUTPUT SEQUENCE 
-.0055 -.0057 -.0055 -.0048 -.0035 -.0017 .0006 .0033 .0064 .0096 
-0126 = .0154 .0177 .0193 .0198 .0189 .0168 .0130 .0078 .0014 
INPUT SEQUENCE 
+1385 = .1247 
INTERPOLATED OUTPUT SEQUENCE 
~,0063 -.0146 -.0234 -.0321 -.0397 -.0457 -.0499 -.0514 -.0501 -.0453 
-.0366 -.0247 -.0091 .0091 .0291 .0500 .0712 .0910 .1084 .1208 
COEFFICIENTS FOR A 1-STAGE DESIGN 
072497 -071163 - 068543 ~064731 059859 .054098 + 047646 
040717 ~033539 ~026336 «019326 ~012707 .006652 ~001303 
-.003232 -.006889 -.009636 -.011483 -.012473 -.012680 -.012202 
-.011157 -.009672 -.007882 -.005918 -.003903 -.001948 -.000148 
.001423 ~002713 003690 ~004343 «004679 ~004723 004512 
-004091 003513 «002830 ~002094 ~001355 000653 000022 
--000513 -.000939 -.001247 -.001440 -.001524 -.001515 -.001428 
-.001284 -.001101 -.000898 -.000692 -,000497 -.000324 -.000179 
-.000069 + 000007 ~000049 -000506 
COEFFICIENTS FOR A 3-STAGE DESIGN 
STAGE 1 
089335 - 086183 -080139 -071694 .061511 050351 .038992 
-028149 +018410 «010192 -003719 -.000967 -.003987 005579 
--006050 -.005730 -.004931 -.003918 -.002890 -.001977 -.001247 
-.000715 -.000364 -.000156 -.000052 
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STAGE 2 
«182858 
-.025777 
003002 
STAGE 3 
430137 
-.041032 
009159 
«005600 
-.007666 
003422 
000614 
-.001770 
001008 
~.000123 
~.000193 


+160221 
~.020599 
+001103 


+168113 
.001697 
-.015612 
~010404 
-.001579 
-.003148 
002976 
-.000931 
-.000381 
-000517 
-,000229 


«120688 
-.011188 
-.000076 


-.068326 
032172 
-.010347 
+ 003210 
.006515 
003542 
000036 
.001366 
-.000918 
000196 
000174 


Table 1 
(Continued) 


073819 
-,002219 
-.000482 


-.080180 
003666 
+011750 

-.009681 
002478 
002179 

-.002601 
001033 
.000160 

~.000387 
000422 


029920 
.003589 
-.000407 


+ 026939 
-.025510 
.010849 
001235 
-.005350 
003484 
-.000410 
-.000990 
-000794 
- 000226 
000276 


003025 
005662 
000202 


. 054430 
- 007056 
+ 008433 
008742 

003079 
001332 
002192 
001054 
-000009 
000273 
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-.021307 
004955 


-.010516 
«020130 
-.010828 
000352 
004213 
-.003281 
.000727 
000662 
-.000658 
.000233 
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Reviewers 


The successful completion of this program book represents the culmination of a joint effort on the part 
of many contributors. The purpose of this section is to acknowledge the extensive efforts expended by 
the reviewers. Their comprehensive testing contributed to the high quality of the programs included in 
the book. 


The following is a complete list of program titles, authors and their affiliations, reviewers and their 
affiliations, as well as computers, operating systems, and FORTRAN compilers used by the reviewers. 


1,1 FOUREA - A Short Demonstration Version of the FFT 
C. M. Rader 
M.LT. Lincoln Laboratory, Lexington, MA 02173 
Reviewed by M. T. Dolan 
Bell Laboratories, Murray Hill, NJ 07974 
Honeywell 6080N computer 
GCos 
FORTRAN Y compiler 


1.2 Fast Fourier Transform Algorithms 
G. D. Bergland and M. T. Dolan 
Bell Laboratories, Murray Hill, NJ 07974 
Reviewed by L. R. Morris 
Carleton University, Ottawa, Canada 
PDP-11/55, 11/60 computers 
RSX-11M 
FORTRAN IV PLUS compiler 
RT-11 
FORTRAN IV compiler 


1.3. FFT Subroutines for Sequences With Special Properties 
L. R. Rabiner 
Bell Laboratories, Murray Hill, NJ 07974 
Reviewed by M. T. Dolan 
Bell Laboratories, Murray Hill, NJ 07974 
Honeywell 6080N computer 
GCOS 
FORTRAN Y compiler 


1.4 Mixed Radix Fast Fourier Transforms 
R. C. Singleton 
SRI International, Menlo Park, CA 94025 
Reviewed by M. T. Dolan 
Bell Laboratoriés, Murray Hill, NJ 07974 
Honeywell 6080N computer 
GCOS 
FORTRAN Y compiler 
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1.5 | Optimized Mass Storage FFT Program 
D. Fraser 
CSIRO, Canberra City, Australia 
Reviewed by N. M. Brenner 
IBM, Yorktown Heights, NY 10598 
IBM 370/168 computer 
VM/370 
FORTRAN IV compiler 
Reviewed by C. A. McGonegal, L. R. Rabiner, and M. T. Dolan 
Bell Laboratories, Murray Hill, NJ 07974 
Data General Eclipse S/230 computer 
RDOS 
FORTRAN V compiler 
Honeywell 6080N computer 
GCOS 
FORTRAN Y compiler 


1.6 Chirp z-Transform Algorithm Program 
L. R. Rabiner 
Bell Laboratories, Murray Hill, NJ 07974 
Reviewed by R. M. Mersereau 
Georgia Institute of Technology, Atlanta, GA 30332 
Data General Eclipse S/230 computer 
RDOS 
FORTRAN 5 compiler (Rev. 6) 


1.7 Complex General-N Winograd Fourier Transform Algorithm (WFTA) 
J. H. McClellan and H. Nawab 
M.I.T., Cambridge, MA 02139 
Reviewed by D. Kolba 
Rice University, Houston, TX 02881 
IBM 370/155 computer 
TSO 
FORTRAN Gl compiler 


1.8 Time-Efficient Radix-4 Fast Fourier Transform 
L. R. Morris 
Carleton University, Ottawa, Canada 
Reviewed by C. M. Rader 
M.LT. Lincoln Laboratory, Lexington, MA 02173 
IBM 370/168 computer 
CMS 
FORTRAN IV compiler 


1.9 Two-Dimensional Mixed Radix Mass Storage Fourier Transform 
R. C. Singleton 
SRI International, Menlo Park, CA 94025 
Reviewed by M. T. Dolan 
Bell Laboratories, Murray Hill, NJ 07974 
Honeywell 6080N computer 
GCos 
FORTRAN Y compiler 
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Periodogram Method for Power Spectrum Estimation 
L. R. Rabiner 
Bell Laboratories, Murray Hill, NJ 07974 
R. W. Schafer and D. Diugos 
Georgia Institute of Technology, Atlanta, GA 30332 
Reviewed by D. E. Dudgeon 
M.L.T. Lincoln Laboratory, Lexington, MA 02173 
PDP11/34 computer 
RT-11 version 3 
FORTRAN IV compiler (version 2.04) 


Correlation Method for Power Spectrum Estimation 
L. R. Rabiner 
Bell Laboratories, Murray Hill, NJ 07974 
R, W. Schafer and D. Dlugos 
Georgia Institute of Technology, Atlanta, GA 30332 
Reviewed by D. E. Dudgeon 
M.LT. Lincoln Laboratory, Lexington, MA 02173 
PDP11/34 computer 
RT-11 version 3 
FORTRAN IV compiler (version 2.04) 


A Coherence and Cross Spectral Estimation Program 
C. Clifford Carter and James F. Ferrie 
Naval Underwater Systems Center, New London, CT 06320 
Reviewed by Jont B. Allen 
Bell Laboratories, Murray Hill, NJ 07974 
Data General Eclipse S/230 computer 
RDOS 
FORTRAN V compiler 


FASTFILT - An FFT Based Filtering Program 
Jont B. Allen 
Bell Laboratories, Murray Hill, NJ 07974 
Reviewed by A. E. Filip 
M.LT. Lincoln Laboratory, Lexington, MA 02173 
IBM 370/168 computer 
CMS 
FORTRAN IV compiler 


Linear Prediction Analysis Programs (AUTO-COVAR) 
A. H. Gray Jr. 
University of California, Santa Barbara, CA 93106 
J. D. Markel 
Signal Technology Inc., Santa Barbara, CA 93101 
Reviewed by Victor W. Zue 
M.LT., Cambridge, MA 02139 
DEC System 20 computer 
TOPS-20 
Standard FORTRAN compiler 
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4.3 


5.1 


5.2 
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Efficient Lattice Methods for Linear Prediction 
R. Viswanathan and J. Makhoul 
Bolt, Beranek and Newman, Inc., Cambridge, MA 02138 
Reviewed by Lloyd J. Griffiths 
University of Colorado, Boulder, CO 80309 
CDC 6400 computer 
KRONOS 
RUN, FTN, and MNF FORTRAN IV compilers 


Linear Predictor Coefficient Transformations Subroutine LPTRN 
A. H. Gray Jr. 
University of California, Santa Barbara, CA_93106 
J, D. Markel 
Signal Technology Inc., Santa Barbara, CA 93101 
Reviewed by Steven F. Boll and George Randall 
University of Utah, Salt Lake City, Utah 84112 
PDP11/45 computer 
RSX11M 
FORTRAN V3 compiler 


FIR Linear Phase Filter Design Program 
J. H. McClellan 
M.LT., Cambridge, MA 02139 
T. W. Parks 
Rice University, Houston, TX 77001 
L. R. Rabiner 
Bell Laboratories, Murray Hill, NJ 07974 
Reviewed by Michael T. McCallig 
Sperry Research Center, Sudbury, MA 01776 
UNIVAC 1106 computer 
EXECS version 33/R3 
FORTRAN V compiler 


FIR Windowed Filter Design Program - WINDOW 
L. R. Rabiner and C. A. McGonegal 
Bell Laboratories, Murray Hill, NJ 07974 
D. B. Paul 
M.L.T, Lincoln Laboratory, Lexington, MA 02173 
Reviewed by D. B. Paul 
M.LT. Lincoln Laboratory, Lexington, MA 02173 
PDP11/45 computer 
UNIX 
Princeton FORTRAN compiler 


Design Subroutine (MXFLAT) for Symmetric FIR Low Pass 
Digital Filters with Maximally-Flat Pass and Stop Bands 
J. F. Kaiser 
Bell Laboratories, Murray Hill, NJ 07974 
Reviewed by D. B. Paul 
M.LT. Lincoln Laboratory, Lexington, MA 02173 
PDP11/45 computer 
UNIX 
Princeton FORTRAN compiler 


A Subroutine for Finite Wordlength FIR Filter Design 
Ulrich Heute 


R-4 


Institut fuer Nachrichtentechnik, Universitaet Erlangen-Nuernberg 
Cauerstrasse 7, D-8520 Erlangen, Germany 
Reviewed by Steven L. Wood 
University of Rhode Island, Kingston, RI 02881 
IBM 370 computer 
ITEL 5 
FORTRAN Level G compiler 
Reviewed by J. F. Kaiser and M. T. Dolan 
Bell Laboratories, Murray Hill, NJ 07974 
Honeywell 6080N computer 
GCOS 
FORTRAN Y compiler 


6.1 Program for the Design of Recursive Digital Filters 
Gunter F. Dehner 
Institut fuer Nachrichtentechnik, Universitaet Erlangen-Nuernberg 
Cauerstrasse 7, D-8520 Erlangen, Germany 
Reviewed by R. M. Mersereau 
Georgia Institute of Technology, Atlanta, GA 30332 
Data General Nova 830 computer 
RDOS 
FORTRAN 5 compiler 
Reviewed by J. W. Woods and J. F. McDonald 
Rensselaer Polytechnic Institute, Troy, NY 12181 
PRIME 500 computer 
PRIMOS 
FORTRAN IV compiler 
Reviewed by J. F. Kaiser and M. T. Dolan 
Bell Laboratories, Murray Hill, NJ 07974 
Honeywell 6080N computer 
Gcos 
FORTRAN Y compiler 
Reviewed by T. W. Parks 
Rice University, Houston, TX 77001 
IBM 370/155 computer 
TSO 
FORTRAN Gl compiler 
Reviewed by Horacio G. Martinez 
Instituto de Ingenieria, Mexico 20, D.F., Mexico 
IBM 370/155 computer at Rice University 
TSO 
FORTRAN GI compiler 
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Program for Minimum-p Synthesis of Recursive Digital Filters 
A. G. Deczky 
Institut de Microtechnique, Universite de Neuchatel 
Rue Pierre-a-Mazel 7, 2000 Neuchatel, Switzerland 
Reviewed by Kenneth Steiglitz 
Princeton University, Princeton, NJ 08540 
IBM 360/91 computer 
OS/360 
FORTRAN G compiler 


An Optimization Program for the Design of 
Digital Filter Transfer Functions 
M. T. Dolan and J. F. Kaiser 
Bell Laboratories, Murray Hill, NJ 07974 
Reviewed by Horacio G. Martinez 
Instituto de Ingenieria, Mexico 20, D.F., Mexico 
Burroughs B6700 computer 
MCP 
B6700/B7700 FORTRAN compiler 


A Program for Designing Finite Word-Length IIR Digital Filters 
Kenneth Steiglitz and Bruce D. Ladendorf 
Princeton University, Princeton, NJ 08540 
Reviewed by John W. Woods 
Rensselaer Polytechnic Institute, Troy, NY 12108 
IBM 370 Model 3033 computer 
MTD 
G and H FORTRAN compilers 


Computation of the Complex Cepstrum 
J. M. Tribolet 
Instituto Superior Tecnico, Lisbon, Portugal 
T. F. Quatieri 
M.LT., Cambridge, MA 02139 
Reviewed by T. Ulrych 
University of British Columbia, Vancouver, Canada 
IBM 370/168 computer 
MTS 
IBM FORTRAN G compiler 


Computation of the Real Cepstrum and Minimum-Phase Reconstruction 
T. F. Quatieri 
M.I.T., Cambridge, MA 02139 
J. M. Tribolet 
Instituto Superior Tecnico, Lisbon, Portugal 
Reviewed by T. Ulrych 
University of British Columbia, Vancouver, Canada 
IBM 370/168 computer 
MTS 
IBM FORTRAN G compiler 
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A Computer Program for Digital Interpolator Design 
T. W. Parks 
Rice University, Houston, TX 77001 
G. Oetken and H. W. Schuessler 
Institut fuer Nachrichtentechnik, Universitaet Erlangen-Nuernberg 
Cauerstrasse 7, D-8520 Erlangen, Germany 
Reviewed by J. M. Tribolet 
Instituto Superior Tecnico, Lisbon, Portugal 
Data General Eclipse $/230 computer 
RDOS 
FORTRAN V compiler 


A General Program to Perform Sampling Rate Conversion 
of Data by Rational Ratios 
R. E. Crochiere 
Bell Laboratories, Murray Hill, NJ 07974 
Reviewed by Don H. Johnson 
Rice University, Houston, TX 77001 
IBM 370/155 computer 
TSO 
FORTRAN Gl compiler 


A Program for Multistage Decimation, Interpolation, 
and Narrow Band Filtering 
R. E, Crochiere and L. R. Rabiner 
Bell Laboratories, Murray Hill, NJ 07974 
Reviewed by Maurice G. Bellanger 
Telecommunications, Radioelectriques et Telephoniques 
5 Ave. Reaumur, 92350 - Plesis, Robinson, France 
Philips P880 computer 
ANSI FORTRAN IV compiler 
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